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Abstract 

The paper presents a unified approach to different fluctuation relations for classical nonequilibrium dy- 
namics described by diffusion processes. Such relations compare the statistics of fluctuations of the 
entropy production or work in the original process to the similar statistics in the time-reversed process. 
The origin of a variety of fluctuation relations is traced to the use of different time reversals. It is also 
shown how the application of the presented approach to the tangent process describing the joint evolu- 
tion of inflnitesimally close trajectories of the original process leads to a multiplicative extension of the 
fluctuation relations. 



1 Introduction 

Nonequilibrium statistical mechanics attempts a statistical description of closed and open systems evolving 
under the action of time-dependent conservative forces or under time-independent or time dependent 
non-conservative ones. Fluctuation relations are robust identities concerning the statistics of entropy 
production or performed work in such systems. They hold arbitrarily far from thermal equilibrium. Close 
to equilibrium, they reduce to Green-Kubo or fluctuation-dissipation relations, usually obtained in the 
scope of linear response theory |86l 144) . Historically, the study of fluctuation relations originated in the 
numerical observation of Evans, Cohen and Morriss 23 of a symmetry in the distribution of fluctuations 
of microscopic pressure in a thermostatted particle system driven by external shear. The symmetry related 
the probability of occurrence of positive and negative time averages of pressure over sufficiently long time 
intervals and predicted that the former is exponentially suppressed with respect to the latter. Ref. [23) 
attempted to explain this observation by a symmetry, induced by the time-reversibility, of the statistics 
of partial sums of finite-time Lyapunov exponents in dissipative dynamical systems. This was further 
elaborated in [55] where an argument was given explaining such a symmetry in a transient situation when 
one starts with a simple state which evolves under dynamics, see also [55] ■ In refs. [351 136|. Gallavotti 
and Cohen provided a theoretical explanation of the symmetry observed numerically in [23] employing 
the theory of uniformly hyperbolic dynamical systems. In this theory, the stationary states correspond 
to invariant measures of the SRB type [81| and the entropy production is described by phase-space 
contraction ^TSl. The authors of [351 136| established a fluctuation theorem about the rate function 
describing the statistics of large deviations of the phase-space contraction in the time-reversible dynamics. 
To relate to the behavior of realistic systems, they formulated the chaotic hypothesis postulating that 
many such systems behave, for practical purposes, as the uniformly hyperbolic ones. They interpreted 
the numerical observations of ref. [53] as a confirmation of this hypothesis. The difference between the 
fluctuation relations for a transient situation analyzed in [251 I26[ and the stationary one discussed in 
[351 136[ was subsequently stressed in [16] . The debate about the connection between the transient and 
stationary fluctuation relations still continues, see e.g. [75] and [33) . 
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In another early development, Jarzynski established in [38] a simple transient relation for the statistics 
of fluctuations of work performed on a system driven by conservative time-dependent forces. This relation 
is now known under the name of Jarzynski equality. A similar observation, but with more limited scope, 
was contained in the earlier work [HEIO, see [S2] for a recent comparison. The simplicity of the Jarzynski 
equality and its possible applications to measurements of free-energy landscape for small systems attracted 
a lot of attention, see [711 172) and the references therein. 

The first studies of fluctuation relations dealt with the deterministic dynamics of finitely-many degrees 
of freedom. Such dynamics may be also used to model systems interacting with environment or with 
heat reservoirs. To this end, one employs simplified finite-dimensional models of reservoirs forced to 
keep their energy constant [24]. This type of models was often used in numerical simulations and in 
discussing fluctuation relations, see e.g. [33] . A more realistic treatment of reservoirs would describe them 
cis infinite systems prepared in the thermal equilibrium state. Up to now, only infinite systems of non- 
interacting particles could be treated effectively, see [211122) . A less realistic description of interaction with 
environment or with reservoirs consists of replacing them by a random noise, usually shortly correlated 
in time. This leads to Markovian stochastic evolution equations. Stochastic models are often easier to 
control than deterministic ones and they became popular in modeling nonequilibrium dynamics. 

In [IS], Jarzynski generalized his relation to time-dependent Markov processes with the instantaneous 
generators satisfying the detailed balance relation. At almost the same time, Kurchan has shown in [56] 
that the stationary fluctuation relations hold for the stochastic Langevin-Kramers evolution. His result 
was extended to more general diffusion processes by Lebowitz and Spohn in [59) . In [BH] , Maes has traced 
the origin of fluctuation relations to the Gibbsian nature of the statistics of the dynamical histories, see 
a recent discussion of fluctuation relation from this point of view in [64]. Searles and Evans generalized 
there transient fluctuation relation to the stochastic setup in [75] . Finally, within the stochastic approach, 
the scope of the transient fluctuation relations was further extended due to the works of Crooks [181 119| . 
Jarzynski [51], Hatano and Sasa [46], Speck and Seifert [77) and Chernyak, Chertkov and Jarzynski [10| . 
just to cite only the papers that influenced most the present authors. It is worth stressing that the 
general transient fluctuation relations do not impose the time reversibility of the dynamics but compare 
the fluctuation statistics of the original process and of its time reversal. Such an extension of the scope 
of fluctuation relations is a possibility in the stationary case as well, but it becomes a necessity in many 
transient situations. Within the theory of the hyperbolic dynamical systems, the stationary fluctuation 
theorem of [35] was recently generalized to the random dynamics in [8]. 

In pP , Balkovsky Falkovich and Fouxon noticed another robust relation concerning the large deviations 
of finite-time Lyapunov exponents in the context of homogeneous hydrodynamic flows. It was remarked in 
[29) , that this observation, which we shall call, following [301 , the multiplicative fluctuation relation, 
provides an extension of the previously known fluctuation relations for the phase-space contraction. The 
simple argument presented in [T] dealt with a transient situation. It was very similar to the original 
Evans-Searles argument as formulated later in [2B]. The multiplicative fluctuation relation was explicitly 
checked in the Kraichnan model of hydrodynamic flows [TJ 1291 111) . 

The theoretical work on fluctuation relations has established most of them as mathematical identities 
holding within precisely defined models, but concerning statistics of events that are rare, especially for 
macroscopic systems. The relevance of such identities to numerical simulations and, even more, to real 
experiments, required a confirmation. Numerical (see e.g. [71 1451 l82l 1381 [85] ) and experimental testing 
of the fiuctuation relations (see e.g. [151 1371 1171 [SJ 1541 147) ) has attracted over years a lot of attention, 
inspiring further developments. It will probably remain an active field in the future. It is not, however, 
the topic of the present paper. 

The growing number of different fluctuation relations made urgent a development of a unifying ap- 
proach. Several recent reviews partially provided such a unification from different points of view, see 
ref. [261 1641 1571 110) . In the present paper, we attempt another synthesis, with the aim of supplying a 
uniform derivation of most of the known fluctuation relations, including the multiplicative ones. We shall 
work in the setup of (possibly non-autonomous) diffusion processes in flnite-dimensional spaces, somewhat 
similar, but more general that the one adopted in [55]. The systems considered include, as special cases, 
the deterministic dynamics, the Langevin stochastic equation, and the Kraichnan model of hydrodynamic 
flow. This is certainly not the most general setup possible for discussing fluctuation relations (for ex- 
ample, the discrete-time dynamics, the stochastic dynamics with jumps, or non-Markovian evolutions 
are not covered), but it is general enough for a unified discussion of a variety of aspects of fluctuation 
relations. Most of our considerations are simple extensions of arguments that appeared earlier in usually 
more constrained contexts. There are two basic ideas that we try to exploit to obtain a larger flexibility 
than in the previous discussions of fluctuation relations. The first one concerns the possible time-reversed 
processes that we admit. This idea appeared already in [10], where two different time inversions were 
used for the Langevin dynamics with non-conservative forces, leading to two different backward processes 
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and two different fluctuation relations. We try to exploit the freedom of choice of the time-inversion in 
a more systematic way. The second idea, which seems original to us, although it is similar in spirit to 
the first one, is to obtain new fluctuation relations by considering new diffusion processes derived from 
the original one. In particular, we show that the multiplicative fluctuation relations for general diffusion 
processes may be obtained by writing a more standard relation for the tangent diffusion process describing 
a simultaneous evolution of infinitesimally close trajectories of the original process. The same idea may 
be used |13] to explain additional fluctuation relations, like the one for the rate function of the difference 
of flnite-time Lyapunov exponents "along unstable flag" that was observed in [11] for the anisotropic 
Kraichnan model. 

The present paper is organized as follows. In Sect.[2j we define the class of diffusion processes that 
will be discussed and list four special cases. Sect.|3] recalls the notions of transition probabilities and 
generators of a diffusion process, as well as the detailed balance relation. In Sect.]!] we introduce the 
tangent diffusion process induced form the original one and define the phase-space contraction. Time 
inversions leading to different backward processes are discussed in Sect.O with few important examples 
listed in Sect .(6] A formal relation between the expectations in the forward and in the backward pro- 
cess is introduced in Sect.[7l As examples, we discuss the case of tangent process in the homogeneous 
Kraichnan flow, a simple generalization of the detailed balance relation and the 1** law of thermodynam- 
ics for the Langevin dynamics. Sect. |8] is devoted to a general version of the Jarzynski equality, whose 
different special cases are reviewed, and Sect .[9] to a related equality established by Speck and Seifert in 
[77| . We formulate the Jarzynski equality as a statement that for a certain functional W of the diffusion 
process, the expectation value of e~^ is normalized. In Sect. 1101 the functional W is related to the 
entropy production and the positivity of its expectation value is interpreted as the 2""* law of thermo- 
dynamics for the diffusive processes. In Sect . 11 II we show how the general Jarzynski equality reduces in 
the linear response regime to the Green-Kubo and Onsager relations for the transport coefficient and to 
the fiuctuation-dissipation theorem. In Sect. 1121 we discuss briefiy a peculiar one-dimensional Langevin 
process in which the equilibrium is spontaneously broken and replaced by a state with a constant flux, 
leading to a modiflcation of the fluctuation-dissipation relation. The model is well known from the theory 
of one-dimensional Anderson localization and describes also the separation of infinitesimally close parti- 
cles with inertia carried by a one-dimensional Kraichnan flow. Sect. 113. 5] formulates in the general setup 
of diffusion processes what is sometimes termed a detailed fluctuation relation [511 119] . an extension of 
the Crooks fluctuation relations [18]. Few special cases are retraced in Sect. 1141 

Up to this point of the paper, the discussion is centered on the transient evolution where the system 
is initially prepared in a state that changes under the dynamics. In Sect. 1151 we discuss the relation of 
the transient fluctuation relations to the stationary ones which pertain to the situation where the initial 
state is preserved by the evolution. The stationary relations are usually written for the rate function 
of large deviations of entropy production observed in the long-time regime. In our case, they describe 
the long time asymptotics of the statistics of W. The Gallavotti- Cohen relation was the first example 
of such identities. We show how the fluctuation relation for the tangent process in the homogeneous 
Kraichnan flow discussed in Sect.[7]leads to a generalization of the Gallavotti-Cohen relation that involves 
the large-deviations rate function of the so called stretching exponents whose sum describes the phase- 
space contraction. In Sect. 1161 we extend such a multiplicative fluctuation relation to the case of general 
diffusion processes. Sect.[T7]contains speculation about possible versions of fluctuation relations for multi- 
point motions and Sect.[T5]collects our conclusions. Few simple but more technical arguments are deferred 
to Appendices in order not to overburden the main text, admittingly already much more technical than 
most of the work on the subject. Some of the technicalities are due to a rather careful treatment of the 
intricacies related to the conventions for the stochastic differential equations that are usually omitted in 
the physical literature. The aim at generality, even without pretension of mathematical rigor, places the 
stress on the formal aspects and makes this exposition rather distant from physical discourse, although 
we make an effort to include many examples that illustrate general relations in more speciflc situations. 
The physical content is, however, more transparent in examples to such examples which are scarce in the 
present text but which abound in the existing literature to which we often refer. Certainly, the paper will 
be too formal for many tastes, and we take precautions to warn the potential reader who can safely omit 
the more technical passages. 

Acknowledgements. The authors are grateful to S. Ciliberto, G. Falkovich, I. Fouxon, G. Gallavotti 
and P. Horvai for discussions. 

2 Forward process 

As mentioned in Introduction, the present paper deals with non-equilibrium systems modeled by diffusion 
processes of a rather general type. More concretely, the main objects of our study are the stochastic 
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processes xt in R"^ (or, more generally, on a d-dimensional manifold), described by the differential equation 

X = ut{x) + Vt{x) , (2.1) 

where x = ^ and, on the right hand side, ut{x) is a time-dependent deterministic vector field (a drift), 
and Vt{x) is a Gaussian random vector field with mean zero and covariance 

{vl{x)viiy)) = Sit-s)Dnx,y). (2.2) 

Due to the white-noise nature of the temporal dependence of vt (typical vt are distributional in time), 
Eq. (|2.ip is a stochastic differential equation (SDE). We shall consider it with the Stratonovich conventiorjj 
[701 [66] ■ keeping for the Stratonovich SDEs the notation of the ordinary differential equations (ODEs). 
Examples of systems described by Eq. (|2.ip include four special cases that we shall keep in mind. 

Example 1. Deterministic dynamics 

Here Vt{x) = and Di\x,y) = so that Eq. (t2TT]) reduces to the ODE 

X = ut{x). (2.3) 



Example 2. Lagrangian flow in the Kraichnan model 

This is a process used in modeling turbulent transport. The SDE (|2.1|l . where one usually takes utix) = 0, 
describes the motion of tracer particles in a stationary Gaussian ensemble of velocities Vt (x) white in time. 
Such an ensemble, with an appropriate time-independent spatial covariance D'^-'(x,y), was designed by 
Kraichnan [62] to mimic turbulent velocities. In particular, homogeneous flows are modeled by imposing 
the translation invariance D'^{x,y) — D^^ (x — y) and isotropic ones by assuming that D^^{x,y) is 
rotation-covariant. In this paper, we shall consider only the case when D^-'{x,y) is smooth. A discussion 
of the case with D'^-'{x,y) non-smooth around the diagonal, pertaining to the fully developed turbulence, 
may be found in or, on the mathematical level, in [6U| . 

Example 3. Langevin dynamics 
Here Eq. ([2T]) takes the fornQ 

= -r^djHt{x) + n''d,Ht{x) + Glix) + C(x), (2.4) 

where F is a constant non-negative matrix and H an antisymmetric one, the Hamiltonian Ht is a, 
possibly time dependent, function, Gt is an additional force, and C^t is the d-dimensional white noise 
with the covariance 

(CtCi) = 2 5it-s)r'r'\ (2.5) 

In this example, the white noise ("t that plays the role of the (space-independent) random vector field Vt 
so that D\-'{x,y) = 2/9~^r*^. For Gt = and a time independent Hamiltonian Ht = H, the Langevin 
dynamics is used to model the approach to thermal equilibrium at inverse temperature (5 [IS]. The 
deterministic vector field —T^-'djH drives the solution towards the minimum of H (if it exists) whereas 
the Hamiltonian vector field H'-' djH preserves H. The noise C^t generates the thermal fluctuations of 
the solution. Note that its spatial covariance is aligned with the matrix T appearing in the dissipative 
force —T^-'djH (such an alignment, known from Einstein's theory of Brownian motion, is often called the 
Einstein relation). Inclusion of the Hamiltonian vector field permits to model systems where the noise 
acts only on some degrees of freedom, e.g. the ones at the ends of a coupled chain, with the rest of the 
degrees of freedom undergoing a Hamiltonian dynamics. The introduction of a time-dependence and/or 
of the force Gt permits to model nonequilibrium systems. In the particular case of vanishing T, the SDE 
(12^4)) reduces to the ODE 

x' = n''djHt{x) + G\{x) (2.6) 
describing a deterministic Hamiltonian dynamics in the presence of an additional force Gt- 

^The choice of the Stratonovich convention guarantees that Ut and Vt transform as vector fields under a change of 
coordinates. 

■^We use throughout the paper the summation convention. 
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Example 4. Langevin-Kramers equation 

This is a special case of the Langevin dynamics that takes place in the phase space of n degrees of freedom 
with X = {q, p) and 

r = p °) , n = I), Ht = m-^p + Vtiq) , Gt = (0, 

where 7 7^ is a non-negative n x n matrix, m^^ a positive one, and 1 the unit one. Here, Eq. (12. 4|) 
reduces to the standard relation Pi — rriijq' between momenta and velocities, where m is the mass 
matrix, and to the second order SDE 

rriijq' = -"iikq' - diVt{q) + fti{q) + d , (2.7) 

that we shall call Langevin-Kramers equation, with the n- dimensional white noise such that 

{OtQt') = 2p-''y,j S{t-t'). 

The Langevin-Kramers equation has the form of the Newton equation with the friction —yq and white- 
noise forces supplementing the conservative one —Wt and the additional one ft. It was discussed in 
[57] in a very similar context. In the limit of strongly overdamped system when the friction term becomes 
much larger then the second order one, the Langevin-Kramers equation (|2.7|l reduces to the first order 
SDE 

■y.kq'' = -diVt{q) + fu{q) + Ci, 

which, if 7 > 0, may be cast again into the form (12. 4p but with r = 7~^, 11 = and Ht = Vt- One 
should keep in mind this change when applying the results described below for the Langevin dynamics 
(|2.4|l to the overdamped Langevin-Kramers dynamics. 



3 Transition probabilities and detailed balance 

Let us recall some basic facts about the difi^usion processes in order to set the notations. We shall denote 
by E^J' the expectation of functionals of the Markov process Xf solving the SDE (|2.H) with the initial 
condition xtg = x. For t > to, the relation 

El°gixt) = j Pt„A^,dy)giy) = {Pt„tg){x) (3.1) 

defines the transition probabilities Ptg^t{x,dy) of the process xt and the operator PtQ,t- The transition 
probabilities satisfy the normalization condition J Ptg^t{x,dy) = 1 and the Chapman- Kolmogorov chain 
rule 



/ 



Pto^t{x,dy) Pta'{y,dz) = Ptg^t'{x,dz) . 



The evolution of the expectation values is governed by the second-order differential operators Lt defined 
by the relation 

^^E'j'gixt) = Ei° {Ltg){xt) . (3.2) 

The explicit form of Lt is found by a standard argument that involves the passage from the Stratonovich 
to the Ito convention. For reader's convenience, we give the details in Appendix A. The result is: 

Lt = Utdi + jdjdl^ di , (3.3) 

where 

d'/ix) = Dmx,x) and ul{x) = ul{x) - ^dyj D"/ {x,y)\y^^ . (3.4) 



Due to the relation p.ip . Eq. (|3.2p may be rewritten as the operator identity dtPtQ,t = Pto,tLt. Together 
with the initial condition PtQ,tQ ~ 1, it implies that Pto,t is given by the time-ordered exponential 



-'to,t = T exp( Lsds^ = ^ / LsiLs2----Ls„ dsids2...dsn ■ (3.5) 



n — O. ^ ^ ^ ^. 



5 



In particular, Pto,t = e'' '"■'^ = Pt-tg in the stationary case with Ut = u and Dt = D. The operator 
Lt = L is then called the generator of the process. 

The stochastic process xt may be used to evolve measures. Under the stochastic dynamics, the initial 
measure fitg (dx) evolves at time t to the measure 

Mt(rfy) = J fJ'toidx) Pto,t{x,dy) . (3.6) 

We shall use below the shorthand notation: /it — fj,oPo,t- For measures with densities jj,t{dx) — pt{x) dx 
with respect to the Lebesgue measure dx, Eq. p.6|) is equivalent to the evolution equation 

dtpt = d,{-~ul + ^dYdj)pt = L\pt, (3.7) 

where L\ is the (formal) adjoint of the operator Lt . The latter relation may be rewritten as the continuity 
equation 

dtpt + V- j = with ft = {ut - \d\^dj)pt, (3.8) 



where V ■ j = dijl is the divergence of the density current jt corresponding to the measure pt (the 
probability current, if pt is normalized). In the case with no explicit time dependence when Lt = L, an 
invariant density p, corresponding to an invariant measure p(dx) = p{x) dx of the process, satisfies the 
equation L^ p = which may be rewritten in the form of the current conservation condition V • j = 0. 
We shall often write the invariant density p{x) in the exponential form as e~'''^^\ One says that the 
process satisfies the detailed balance relation with respect to if the density current j related to 
the measure p{dx) = e~^^^'^dx vanishes itself, i.e. if 

u = -id'^aj(^ , 

Equivalently, this condition may be written as the relation 

Lt ^e-^Le^, 

for the generator of the process or as the identity 

p{dx) Pt{x,dy) = p{dy) Pt{y,dx) (3.9) 

for the transition probabilities. In all these three forms, it implies directly that p is an invariant measure. 
The converse, however, is not true: there exist stationary diffusion processes with invariant measures that 
do not satisfy the detailed balance relation. 

The generator of the stationary Langevin equation with 11 = and G = satisfies the detailed 
balance relation with respect to ip = [3H so that the Gibbs density p{x) = e"'^^'^'^-', and, if the latter is 
normalizable, the Gibbs probability measure p'^ {dx) = Z~^e~^^^''^dx, are invariant under such dynam- 
ics. The invariance still holds when 11 7^ but, in this case, the detailed balance relation fails. We shall 
see below how to generalize the latter to catch also the case with conservative forces when 11 7^ 0. 



4 Tangent process and phase-space contraction 

One may generate other processes of a similar nature from the diffusive process (|2.1|l . Such constructions 
will play an important role in studying fiuctuation relations. As the first example, let us consider the 
separation (5xt between the solution Xt of Eq. with the initial value xq = x and another solution 
infinitesimally close to Xt. Such a separations evolves according to the law 

5xf = Xt{x)5y.o, 

where the matrix Xt (x) with the entries 

K,{x) = ^{x) (4.1) 

OXq 

solves the (Stratonovich) SDE 

= {dkn't + dkvl){xt)X'', (4.2) 
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with the initial condition Xo(a;) = 1. Together with Eq. (|2.1|) . the SDE (|4.2p defines a diffusion process 
(xt,Xt) that we shall call the tangent process. In particular, the quantity — IndetXt that represents 
the accumulated phase-space contraction along the trajectory Xt, solves the SDE 

^(-IndetX) = ~{\/ -ut + V ■vt){xt) . (4.3) 
The right hand side of Eq. (I4.3|l is the phase-space contraction rate. We infer that 

T T 

-IndctXt = - J{V ■ut){xt)dt - J{V ■vt){xt)dt. (4.4) 



The second integral on the right hand side should be interpreted with the Stratonovich convention. The 
phase-space contraction is an important quantity in the study of nonequilibrium dynamics and it will 
reappear in the sequel. 

5 Backward processes 

Among the diffusion processes that may be generated from the original process (|2.ip are the ones which 
may be interpreted as its time reversals. The action of time inversion on space-time will be given by the 
transformation 

{t,x) — > {T-t,x') = (t*,x*) (5.1) 

for an involution x >—> x* . It may be lifted to the level of process trajectories by defining the transformed 
trajectory xt by the relation 

Xt = xt, . (5.2) 

In general, however, we shall not define the time-reversed process as Xt because, in the presence of 
dissipative deterministic forces like friction, such time inversion would lead to an anti-dissipative dynamics. 
We shall then allow for more fiexibility. In order to define the time-reversed process, we shall divide the 
deterministic vector field Ut into two parts 

ut = itt,+ + Ut,- , (5.3) 

that we shall loosely term dissipative and conservative, choosing different time-inversion rules for them. 
The time-reversed process xj will be given by the SDE 

x' = u't{x') +v't{x') (5.4) 

with the deterministic vector field = ^ + u't,_ and the random one v't defined by the equations 

'u'l,±{x) = ±{dkX*''){x*)ut,^^{x*) and v'l{x) = ±{dkx'"')(x*) Vt, {x*) . (5.5) 

Note that ut,+ transforms as a vector field under the involution a; i— > x* and ut,~ as a pseudo-vector 
field. For vt we may use whichever rule since Vt and —vt have the same distribution. The SDE (|5.4p for 
the time-reversed process x't coincides with the one for the process xt defined by Eq. (|5.2|l if and only if 
ut,+ vanishes and vt is transformed according to the pseudo-vector rule. We shall call xj the backward 
process referring to Xt as the forward one. The random vector field v't of the backward process is again 
Gaussian with mean zero and white-noise behavior in time. Its covariance is 

{vti^X'iy)) = Sit-s)D':^ix,y), 

where 

D':^x,y) = {dkx")ix'')D'^i{x\y'){dix''){y-). (5.6) 
As before, see Eqs. (|3.4|) . we shall denote 

dt^{x) = D't^{x,x), Ut{x) = Ut{x) - ^dyjD['^x,y)\y=x . (5.7) 



Remark 1. Using the chain rule {djX*''){x*){dkX*-'){x) = SI, it is easy to see that the time-inversion 
transformations (15.511 are involutive. 
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Let us emphasize that the choice of a time inversion consists of the choice of the involution l|5.ip and of 
the splitting (|5.3|l of Ut- We shall call the process time-reversible (for a given choice of time inversion) 
if the deterministic vector fields u and u' of the forward and of the backward processes coincide and if 
the respective random vector fields vt and v't have the same distribution, i.e. if 

ul_+{x) + Ut,_(a;) = {dkX*"){x*) {ut.^ + {x*) - Ut*-{x*)) 

and if 

Dl'{x,y) = {d,x")i^*)D'^!{x\y*)idix*'){x*). (5.8) 
Note that the first identity is equivalent to the relations 

nl^ix) = '-{ul{x) ± {d,x")ix')u^4xn) (5.9) 

and can be always achieved by taking such a splitting of itt. It may be not easy, however, to realize 
physically the backward process corresponding to the splitting (|5.9|l . The second condition (|5.8|l is a 
non-trivial constraint on the distribution of the the white- noise velocity vt . Nevertheless, if Dt is time- 
independent, it may be satisfied by choosing the trivial involution x* = x. 

Parallelly to the splitting (|5.3p of the drifts ut and u't, we shall divide the operators generating the 
forward and the backward evolution into two parts: 

Lt = Lt,+ + Lt,^ , L't — L't^^ + L't^_ 

according to the formulae: 

Lt.+ = iil^^di + ^djdl^ di , Lt - = ?it,_9i , 

Lt,+ = u'l^_di + ^djd't'di , Li,_ = u'l_di. 

The time-inversion rules become even more transparent when expressed in terms of the split generators. 
Let R denote the involution operator acting on the functions by 

{Rf)(x) = fix') ■ (5.10) 

Lemma 1. 

L't,± = ±RLf,±R. (5.11) 

Proof of Lemma 1, involving a straightforward although somewhat tedious check, is given in Appendix 
B. 

Below, similarly as for the forward process, we shall denote by E'J:° the expectation of functionals of 
the backward process satisfying the initial condition xj^ — x. For t > to, the relations 

t 

E':° 9{<) = {K,t9){x) with P;,t = T exp (| Li ds) 

to 

define the operators whose kernels give the transition probabilities of the time- reversed process xj. 

6 Examples of time-inversion rules 

The preceding considerations were very general. Physically, not all time-inversion rules for the diffusive 
processes (|2.1|l described above are on the equal footing. In particular situations, some rules may be more 
natural or easier to implement than the other ones. Let us list here few cases of special time inversions 
that were discussed in the literature and/or will be used below. 

6.1 Natural time inversion 

Taking the trivial splitting ut,+ = 0, itt,_ — ut combined with an involution x x* leads to the 
time-inversion rules that produce the backward process with trajectories related by the transformation 
(|5.2|) to the ones of the forward process if the pseudo- vector field rule is used when transforming vt. This 
is the time inversion usually employed for the deterministic systems but it may be used more generally. 
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6.2 Time inversion with + = 

Consider the time inversion corresponding to an arbitrary involution x x* and the choice 

Ut.+ — 0, ut,- — ut ■ (6.1) 

of the splitting of ut- Such a time inversion is a slight modification of the natural one to which it reduces 
in the case of deterministic dynamics (|2.3p with vt = 0. As we show in Appendix C, the backward 
dynamics corresponding to the splitting (jG-lf) is given by the relations 

Ut,+ {x) = ^d['^{x){dj\na){x), Ut].{x) = -{dkx'"){x*) Ut,{x*) , (6.2) 

where <t{x) = a{x*)~^ denotes the absolute value \det{djx'"'){x)\ of the Jacobian of the involution 
X ^ X* . The time inversion considered here will be used to obtain fiuctuation relations in the limiting 
case of deterministic dynamics (|2.3p when D]-' is set to zero and the backward dynamics is given by the 
ODE 

i'* = u't{x') for u"(x) = — (c'fex")(a;*) Ut. (x*) . (6.3) 
obtained from the ODE (|2.3p by the natural time inversion. 

6.3 Time inversion in the Langevin dynamics 

To explain why the rules of time inversion with non-vanishing ut,+ are more generally needed, we consider 
the case of the Langevin dynamics that involves the dissipative force —WHt- Let us arbitrarily split 
the corresponding drift ut into two parts: 

Ut = -rVHt + UVHt + Gt = ut.+ + Ut,- , (6.4) 

see Eq. (|2.4|l . Recall the relation (|2.5p that aligns the matrix F with the covariance of the white-noise 
Vt = Ct- It is natural to require the backward dynamics to be also of the Langevin type but for the 
time-reversed Hamiltonian H't{x) — Ht*{x*). This requires that 

u't = -r'VH't + n'vm + G't ^ u't,+ + u't,_ , (6.5) 

and that v't{x) = (,[ with the covariance of the white noise C,t aligned with matrix F' as in Eq. (|2.5p . 
Upon restriction to linear involutions x* = rx with = 1, the transformation rules (|5.5|l become 

u't,±{x) = ±rut*,±{rx), Ci = ±rCt* • 

The condition on the covariance of C,t imposes the relation F' = rVr^ . Applying r to the both sides of 
Eq. (|6.5p taken at time t* and at point rx, we infer that 

-rT'r'^\IHt{x) + rU' r'^SI Ht{x) + rG't, {rx) = ut,+ {x) ~ ut,-{x) . 

The latter identity, together with Eq. (|6.4p . result in the relations 

ut,+ {x) = -VVHt(x) + \{Ii + rU'r'^)S7Ht{x) + \{Gt(x) + rG't,{rx)) , 
ut.-{x) = -^\{Il-rn'r'^)S7Ht{x) + \[Gt{x) - rG't-.{rx)) . 

At least when F is strictly positive, Ht is not a constant, and the extra force Gt is absent, one infers 
that the component Ut,+ cannot vanish identically by considering the contraction {\/Ht)-ut,+. We shall 
call canonical a choice of the time inversion for the Langevin dynamics for which 

F' = rVr^ = r , n' = -rHr^ = H , (6.6) 

ut,+ = -VVHt , Ut,- = UVHt + Gt . (6.7) 

Note that such a time inversion treats the force Gt as a part of ut,- even when this force is of the 
non-conservative type. The Langevin dynamics is time-reversible under a canonical time inversion if 
Ht — Ht and G't — Gt- For the Langevin-Kramers equation, the standard phase-space involution 
(q,p)* = r{q,p) — {q,—p) verifies Egs. (|6.6 p and it leads to the particularly simple canonical time- 
inversion rules with 

= Vt* , ft = ft' 

and to the time-reversibility if Vt = Vt* and ft = ft* ■ 
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6.4 Reversed protocol 

The time inversion corresponding to the choice 

ut,+ = ut , Uf,_ = (6.8) 

and trivial involution x* = x was termed in [10) a reversed protocol. It may be viewed as consisting of 
the inversion of the time-parametrization in the vector fields in the SDE (12. ip . if the vector- field rule is 
used to reverse vt- In the stationary case, where it results in time-reversibility, such a time inversion was 
employed already in [59]. Here, we shall admit also a possibility of a non-trivial involution x i-^ x* . The 
reversed protocol leads then to the backward process with 

u't]+ = {dkx")ix*)ut*{x*) , u'\__ =0, v't ^ {dkX*'){x*)vt,{x*) . (6.9) 

6.5 Current reversal 

Suppose that e~^* are densities satisfying I/Je"*^* — 0. Such densities would be preserved by the 
evolution if the generator of the process were frozen to Lt- The density current corresponding to e"*^* 
has the form 

ft = (u? + idi^(9jV3t)) e"^* , 

see Eq. (|3.8|l . It is conserved due to the relation Lje"'''' = 0. The time inversion defined by the choice 

= -^dl^diipt, ttj,- ^ Ut + \d\^diipt (6.10) 

and an arbitrary involution x ^ x* leads, after an easy calculation using the results of Appendix C, to 
the backward process with 

Ut,+ ^ ~ \dt^ djif't , u'l_{x) = -{dkx"){x*)u'l,_{x'') v'^ = ±{dkx"){x*)vl.{x*) (6.11) 

for if'ti^x) = [tpt' +\na){x*). The density current for the backward process corresponding to the densities 
e"^* is 

jt = {u't +\d':\d,^[))e-'^'^ = <_(:E)e-^'(^> = -(a,a;")(a;*) «?.,_(x*) e""^** (^*V(x) 
= -{dux"){x*){u'l,{x*) +\d!^{x*){d,^,>){x*))e-''' a{x)= - {dux"){x*) j\x*) a{x) (6.12) 

and is also conserved, as is easy to check. It follows that L'^e'^^t = 0. We shall term the time inversion 
corresponding to the choices (|6.1Up the current reversal. For x* = x when it just reverses the sign of 
the current, it was already employed in an implicit way in [33], and was introduced explicitly (under a 
different name) in [10] . The latter reference discussed also a simple two-dimensional model for which the 
inverse protocol and the current reversal led to different backward processes. 

6.6 Complete reversal 

Finally, modifying slightly the last scheme, let us suppose the densities pt = e~'^* evolve under the 
dynamics solving Eq. (13. 7p . With the same splitting (|6.10p as for the current reversal, we obtain the 
backward process for which Eqs. (|6.1ip and (|6.12p still hold for ip't{x) = (ipt* -|- lncr)(a::*). We shall call 
the corresponding time inversion the complete reversal. Unlike in the other examples, it depends 
also on the choice of the initial density po and may be difficult to realize physically. The time-refiected 
densities p[ = e"*"' evolve now according to the backward-process version of Eq. (|3.7p . The current 
reversal and the complete reversal coincide in the case without explicit time dependence and with the 
choice of ipi = V such that e~'^cix is an invariant measure. 

7 Relation between forward and backward processes 

A comparison between the forward and the backward processes will be at the core of fiuctuation relations 
that we shall discuss. To put the processes in the two time directions back-to-back, we shall adapt to 
the present setup the arguments developed in Sect. 5 of |59] . Let us introduce a perturbed version of the 
generator Lt of the forward process, 

L] = Lt - 2ul^^di - (diiil^^) + {diul_) . (7.1) 
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Operator Lj is related in a simple way to the generator of the backward process: 

R [lIYr = R {d^ui+ - ^^ul_ + +i^^dl'^, - {d^ui+) + (a,Mi,_)) R 

= RLt,+R - RLt.-R = L't, , (7.2) 

where R is defined by Eq. (|5.f 0|l and the last equality is a consequence of the relations (|5.1H) . Let us 
consider the time-ordered exponential of the integral of Lj. Using the relation Ll — (RL'^tRy that 
follows from Eq. (|7.2p . we infer that 

t <o 
P4,t = T exp ( y"L^ ds) = T exp ( y" {RL'^rY ds) 

to t' 

= [t? T exp L; ds) i?]^ = (i?P;.,,. J?)^ . (7.3) 

Above, the first inversion of the time order from T to T was due to the change of integration variables 
s s* — T ~ s, and the second one, to the fact that the hermitian conjugation reverses the order in 
the product of operators. Let us remark that A{y,dx) is the kernel of the operator and A{x*,dy*) 
of the operator RAR if A{x, dy) is the kernel of a real operator A. Rewriting Eq. (|7.3|l in terms of the 
kernels, with these comments in mind, we obtain the identity 

dx Pt\^t{x,dy) = dy P/.^^. (y', dx*) . (7.4) 



Remark 2. The transition probability of the backward process on the right hand side may be replaced 
by the one of the forward process in the time-reversible case. 

Note that the 2"^^ order differential operator Ll differs from Lt only by lower order terms, see 
Eq. (|7.ip . A combination of the Cameron-Martin-Girsanov and the Feynman-Kac formulae [7S] permits 
to express the kernel Ptg^t{x,dy) as a perturbed expectation for the forward process. 

Lemma 2. If the matrix (dj-'(a;)) is invertible for all t and x then 

t 

Pt\A^^dy) - Ei° e *o ° '5{xt~y)dy, (7.5) 

where 

Jt = 2ut,+ (xt) ■ dt~^(xt) xt - 2Mt,+ (xt) ■ dt~^(xt) ut,_(xt) - (V ■ ut,_)(xt) (7.6) 

is a (local) functional of the solution Xt of the SDE (12. The right hand side of Eq. (|7.6|l uses the vector 
notation. The first term in the expression for Jt has to be interpreted with the Stratonovich convention. 



Proof of Lemma 2 is deferred to Appendix D. A combination of the relations (|7.5|l and (|7.4|l gives 
immediately 



Proposition 1. 



dx Ei° e *o 5{xt ~y)dy = dy P/.,,. {y*,dx') . (7.7) 

□ 



This is the first fiuctuation relation of a series to be considered. It connects the transition probability of 
the backward process to an expectation in the forward process weighted with an exponential factor. Let 
us illustrate this relation in a few particular situations related to the examples of the diffusion processes 
considered in Sect.[51 
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Example 5. Tangent process in the stationary homogeneous Kraichnan model 

Recall Sect.Udevoted to the definition of a tangent process. Let us consider the tangent process (xi,Xt) 
with fixed initial data xo = a; and Xo = 1 for the homogeneous Kraichnan model. As was discussed in 
detail in [40], in this case, the distribution of the process Xt may be obtained by solving, instead of the 
SDE (IT^ with ut = 0, a simpler linear Ito SDE 

dX = StdtX (7.8) 

with a matrix-valued white-noise St such that 

{SI, Si,) = -5{t-s)d,diD'^{0). 

In other words, in Eq. (|4.2p . we may replace dkV^{xt) by dkVt{0) = SI,, if we change the SDE convention 
to the Ito one at the same time. Consequently, in the homogeneous Kraichnan model, the process Xt 
may be decoupled from the original process xj. Let us abbreviate: —dkdiD]!'(Q) — C]^,. Remark the 
symmetries C^^j = Cfjl = — Cf.]. The Ito SDE (17. 8p may be rewritten as the equation 

X', = -'^CIIX'^ + SliX'^ (7.9) 

that employs the Stratonovich convention. Upon the use of the notations: 

f/^ (X) = - i at x\ , (X) = SI ,x\, 

it may be cast into the form 

X = t/(X) + Vt{X), (7.10) 

falling within the scope of (stationary) diffusion SDEs (|2.1I) and defining a Markov process Xt. The 
covariance of the white-noise "velocity" Vt(X) is 

iyi, (X) (y )) = 5{t ~ s) D^, (X, Y) with DZ {X, Y) = c;^ x\ yt . 

As in the general case (13. 4|) . we shall denote: 

d^^m = D^^,{X,X) , U',{X) = U)(X) - i d^.D}nX,Y)\^^^ = -^Icl^l Xj= . 

Let us apply the reversed-protocol time inversion discussed in Sect. 16.41 to the forward SDE (I7.10p . 
It corresponds to the trivial splitting of U with U+ — U and [/_ = and to an involution X i-^ X* 
that we shall also take trivial: X* = X. The backward evolution is then given by the same equation 
(|7.9p with St replaced by S't — St', a matrix- valued white noise with the same distribution as St- The 
time-reversibility follows. Suppose that the covariance C of the white noise S{t) is invertibl^fl, i-e. that 
there exists a matrix (C~^)j^ such that C^^iiC'^Yj^n = S'^S, ■ Then the matrix 

{d-'y-,ix) = {x-'y,ix-'r^{c-Xm 

provides the inverse of d^-'j(X). Substituting these data into Eq. (|7.6|l . we obtain 

Jt = 2{Uy,{Xt){d-yrm{>^t)XT„ = -(d+l) O^t^T^y^Tn = -(d+ 1) ^ln|detXt|. 
The relation (|7.7|l applied to the case at hand leads to the identity 

dXo Pt(A:o,dA:) |detXor'''+^'|detX|''+^ = dX Pt{X,dXo) , (7.11) 

where Pt{Xo, dX) denotes the transition probability of the forward process Xt solving the SDEs l|7.8|) or 
(|7.9|l and dXo on the left hand side and dX on the right hand side stand for the Lebesgue measures on 
the space of d x d matrices. We made use of the fact that the backward process has the same law as the 
forward one. Eq. (|7.1ip is nothing else a the detailed balance relation with respect to tfiiX) = In | det Xj. 
Indeed, note that the density current corresponding to the density p{X) — \ detX|~''^^ 

j{X) = (f/(X) + id(X)V^)|detXr''+\ 

see Eq. (|3.8|l , vanishes. 
^The assumption about inversibility of C may be dropped at the end by a limiting argument. 
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Integrating the left hand side of the above identity against a function f{Xo,X) and using the relation 
Pt{Xo,dX) = Pt{l,d{XXo^)) that follows from the invariance of the corresponding SDE under the right 
multiplication of X by invertible matrices, we obtain the equalities 



fiXo,X) det{XXoy+UXoPtiXo,dX) = J /(X„,X) detiXXo^+UXo Pt{l,d(XXo^)) 
= j f{Xo,XXo){AetXf+^ dXoPt{l,dX) = J f{X-^Xo,Xo) (det X) dXo Pt{l,dX) , 

where we twice changed variables in the iterated integrals. On the other hand, the integration of the right 
hand side of Eq. (|7.1ip against f{Xo,X) gives 

J f{Xo,X)dXPtiX,dXo) = J f{X,Xo)dXoPt{Xo,dX) = J f{XXo,Xo)dXoPt{l,dX) 
= f fiX-^Xo,Xo)dXoPt{l,dX-^^). 



Comparing the two expressions, we infer that 

Pt(l,dX)(detX) = Pt(l,dX-'). (7.12) 

This is a version of the Evans-Searles [25^ fluctuation relation for the stationary homogeneous Kraichnan 
model. In the context of general hydrodynamic flows, it was formulated and proven by a change-of- 
integration- variables argument in p], see also [40]. We shall return in Sect .[15] to the relation (I7.12|) in 
order to examine some of its consequences. Subsequently, we shall generalize it in Sect.[TS]to arbitrary 
diffusion processes of the type (|2.ip . 



Example 6. Generalized detailed balance relation 

Consider the complete-reversal rules discussed in Sect . 16.61 and corresponding to the choice (|6.1Up . Since, 
by virtue of the assumption that the densities e"*^' evolve under the dynamics, see Eq. (|3.7p . 

L|e-*" = -ftuj,_e-*" = e-'^' {ul_dm - d,ul_) = -e"^*'"' (a^v^) W , (7.13) 
the last two terms in the definition (|7.6|l reduce to — {dt(pt)('X-t) in this case so that 

Jt = -(V</Pt)(xt)-Xt - {dt<pt){xt) = -4v5t(xt)- (7-14) 

at 

Upon integration over time, this produces boundary terms and Eq. (|7.7|l implies the generalized de- 
tailed balance relation: 

fj.o{dx) Po.Tix,dy) = firidy) Po^riv* ,dx*) , (7.15) 

for jj,t{dx) = e~'^*'^^^ dx. Note that Eg. (|7.15|l holds for any choice of the involution x t-» x* . Upon 
integration over x, Eq. (|7.15p assures that the measures stay invariant under the dynamics, what 
was assumed from the very beginning. In the case with no explicit time dependence, i.e. when Lt = L, 
Eq. (|7.15|l holds, in particular, for ipt = such that jj, = e'^^dx is an invariant measure. In that case, 
the generalized detailed balance relation reduces to the detailed balance one (|3.9|l if u- in the splitting 
1)6. lOp vanishes and x* = x. This was the case in Example 5. Below, we shall see examples where the 
invariant measure /i is known and the generalized detailed balance relation holds but where the detailed 
balance itself fails. Some of those cases fall under the scope of the Langevin dynamics. Let us discuss 
them first. 

Example 7. law of thermodynamics and generalized detailed balance for the Langevin dynamics 
For the Langevin dynamics with the splitting (|6.7p of the drift, a direct substitution yields 

Upon the use of the dynamical equation (12. 4p . 

T T 

j Jtdt ^ J [P{VHt){xt)-r{\/Ht)ixt) - /3(VJi't)(xt)-0 - (V-Gt)(xO]dt = /3Q , (7.16) 
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where Q may be identified with the heat transfered to the environment modeled by the thermal noise. 
On the other hand, using the original expression for Jt together with the (Stranonovich convention) 
identity ^ Ht{xt) = (V-fft)(xt) ■ Xt + (dtHt){y~t), we obtain the relation 

T 

I Jtdt = -/5AU + /3W, (7.17) 



where AU = Ht{x-t) — Ho{xo) is the change of the internal energy of the system and 

T 

W = J [idtHt){xt) + {VH){xt)-Gtiy<t)~p-\\7-Gt)ixt)]dt (7.18) 



may be interpreted as the work performed on the system. With this interpretations, a comparison of the 
two expressions for the integral of Jt leads to the 1"* law of thermodynamics: 

AU = -Q + W. (7.19) 

This was discussed in a simple example of the forced and damped oscillator in [53]. In the absence of the 
extra force Gt, the expression for the work reduces to 

T 

W = {dtHt){xt)dt (7.20) 



and represents the so called Jarzynski work introduced first in [48] for deterministic Hamiltonian 
dynamics. In the stochastic Langevin-Kramers dynamics, the expressions for the heat and the work 
become: 



i 1 
Q = J [qt-iqt - qt-Ctjdt, \N = J [(dtVt){qt) + qt ■ ft{qt)]dt . (7.21) 


The second quantity is equal to the sum of the Jarzynski work and of the work of the external force ft. It 
was introduced and discussed in j57_. In the stationary case, it reduces to the injected work |56j and, up to 
the /3-factor, coincides with the "action functional" (for uniform temperature) given by Eq. (6.3) of [59] . 
Note that the general expression (|7.18|) for work makes also sense in the case of deterministic dynamics 
1)2. 6[) obtained from the SDE (|2.4|l by setting F = 0, in particular for the deterministic Hamiltonian 
evolution with Gt = 0. 



If Gt = 0, the splitting (|6.7|l is a special case of the splitting used for the current reversal for ipt — 13 Ht, 
see Eq. (|6.10p . In particular, if Ht = H then the transition probabilities of the Langevin process satisfy 
the generalized detailed balance relation (|7.15p that takes the form 

^l{dx)PT{x,dy) = fi{dy)Pfr{y*,dx*) (7.22) 

for ii{dx) = e~^^^^^dx and any involution x i-^ x* = rx. The latter identity replaces the detailed 
balance relation (|3.9[l in the presence of the conservative force UVH and still assures that the Gibbs 
density e~'^^ is invariant under such Langevin dynamics. If the involution r satisfies additionally the 
relations (|6.6|) and H{rx) — H{x), resulting in the time-reversibility, then one may replace by Pt 
in the relation (|7.15|l . 

Example 8. Linear Langevin equation 
Consider the linear SDE 

X = Ma; + 0, (7.23) 



where M is a d x d matrix and (^t is the white noise with the covariance (|2.5|l and matrix F strictly 
positive. We shall be interested in cases when the matrix F~^M is non-symmetric. For an elementary 
discussion of mathematical aspects of such SDEs see e.g. [42] . In the context of nonequilibrium statistical 
mechanics, examples of such linear equations were considered in [58] as models of a harmonic chain of 
oscillators interacting with environment of variable temperature or, quite recently, in [80] for modeling 
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coiled polymers in a shearing flow. The diflFusion process xt that solves Eq. (|7.23p with the initial value 
xo = a; is given by the formula 



t 

Xt = e X + ' Csds. 



The transition probabilities of this process are Gaussian and have the explicit form 

Pt{x,dy) = det(2^/3-^Ct)-'/' e^p [~ ^{y - e'^' x) ■ Cr\y - e'^' x)]dy , (7.24) 



where 



Ct = 2 / e""re"*' ds (7.25) 



is a strictly positive matrix. Suppose that all the eigenvalues A of Al have negative real parts. Under 
this condition, e**^ tends to zero exponentially fast when t — ^ cxa so that Coo = C is finite and 

Pt{x,dy) det(2nr'C)-'/^ e^p\~^yC-'y]dy, 

t—'OO L z J 

with the right hand side defining the unique invariant probability measure of the process. This Gaussian 
measure has the form of the Gibbs measure for the quadratic Hamiltonian 

H{x) = ^x-C-\. (7.26) 

Introducing the matrix 

n = r + MC. (7.27) 

that is an antisymmetric: 



n + = 2r + 2 y e"'"(Afr + rAf' )e"''' ds = 2r + 2 j ^e'^^'re"'" ds ^ 0, 



the linear SDE (|7.23|l may be rewritten in the Langevin form (|2.4|) as 

X = -rVH{x) + UVH{x) + Ct ■ (7.28) 

Conversely, the last SDE with H as in Eq. (|7.26p for some C > is turned into the form (|7.23p upon 
setting 

M = -(r-n)C"\ (7.29) 

Note that the last equation implies the relation (I7.27P for H. In Appendix E, we show that AI given by 
Eq. (|7.29|l has necessarily all eigenvalues with negative real part and that C may be recovered from M 
as Coo given by Eq. (I7.25P with t = oo. This establishes the equivalence between the SDEs (|7.23p and 

rrm . 

The probability current associated by the formula (|3.8p to the Gaussian invariant Gibbs measure 
fi'^idx) = Z-^e-^^f^'da; is 



jix) = Z-^nC'^xe 



-f3H(x) 



It vanishes only when 11 = 0. In the latter case, the transition probabilities (|7.24p satisfy the detailed 
balance relation (|3.9p for ip = f3H + lnZ. If 11 7^ then only a generalized detailed balance relation 
1)7. 22p holds for any choice of the linear involution x i—y x* = rx. If moreover rFr^ — F, rllr"^ = —11 
and rCr^ — C then on the right hand side of Eq. (|7.15p may be replaced by Pt- 
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8 Jarzynski equality 



We shall exploit further consequences of the relation (|7.7|) between the forward and backward processes. 
In this section we shall derive an identity that generalizes the celebrated Jarzynski equality [481 149) and 
shall prepare the ground for obtaining more refined fluctuation relations following the ideas of [31] , [63[ 
and [19]. Let ipo and ipr be two functions generating measures 

fioidx) = e-^^^'^dx, uridx) = e''"'^'^''^ dx , (8.1) 

respectively. In particular, we could take e"*^^'^' such that the measure jir is related to /^o by the 
dynamical evolution ([3.6[l . i.e. /it = ^o-Po.t, but we shall not assume such a choice unless explicitly 
stated. In general, the measures ([8.1|l may be not normalizable but we shall impose the normalization 
condition later on. We shall associate to /iq and ^lt the time-reflected measures 

ti'oidx) = e-^o("'da; = e-^^<"*'da;* , tiridx) = e-*'^<"^da: = e-*'»<"*'da;* . 

T 

Let us modify the functional J Jt dt introduced in the last section by boundary terms Aip = (fTixr) — 



VPo(xo) by setting 

T 

W ^ + J Jtdt. (8.2) 



The functional W will be the basic quantity in what follows. Its physical interpretation in terms of the 
entropy production will be discussed in the Sect. 1101 below. 

For any functional jT on the space of trajectories xt parametrized by time in the interval [0,T], we 
shall denote by the functional defined by J-{x) = .7^(x), where x is given by Eq. ([5.2|l . We shall also 
introduce the shorthand notation 

El'^^y ^(x) = El .F(x) 5(XT - y) 

for the (unnormalized) expectation of the process xt with fixed initial and final points, and similarly for 
the backward process. The following refinement of the relation ([7.7p of Proposition 1 holds: 



Proposition 2. 

lioidx) E'l;fy e-"^W dy = fi'o{dy') E'^- -^(x) dx* (8.3) 



Proof of Proposition 2 is contained in Appendix F. Note that the explicit dependence on the choice of 
measures /io and /ip trivially cancels the one buried in W. In particular, for T = 1, Proposition 2 
reduces to Proposition 1 with to = Q and t — T. As before, the backward-process expectation E' may 
be replaced by the forward-process one E for the time-reversible process. 

If the measures /io and h'q are normalized then we may use them as the probability distributions of 
the initial points of the forward and of the backward process, respectively. The corresponding probability 
measures M{dx) and M'{dx') on the space of trajectories on the time-interval [0,T] are given by the 
relations 

j T{x)M(dx) = j (^E'iT{x)')fioidx) = {^), (8.4) 

I :F{x')M'{dx') = j (e'S H^)) = (t). (8.5) 

Upon integration over x and y, the identity ([8.3p induces the following equality between the expectations 
with respect to the trajectory measures M and M' : 



Corollary 1. 



^e-^) = (t) (8.6) 
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It was stressed in [63], and even more explicitly in [19] . that the identity of the type of (18. 6[) . comparing 
the expectations in the forward and the backward processes, is a source of fluctuation relations. An 
important special case of Eq. (|8.6p is obtained by setting T = 1. It was derived in [48] in the context of 
the Hamiltonian dynamics and in QS] in the one of Markov processes: 

Corollary 2 (Jarzynski equality). 

= 1. (8.7) 



Let us illustrate the meaning of the above relation by considering a few special cases. 



Example 9. The case of Langevin dynamics 



With the splitting (|6.7p used for the canonical time inversion, upon taking <pt = f3{Ht — Ft), where 
Ft = — /3~^ In J e"''^' da; denotes the free energy, we infer from Eq. (|7.17|l that 

W = /3(W - AF) , (8.8) 

where AF — Ft — Fq is the free energy change and W is the work given by Eq. (|7.18[) . The difference 
W — AF is often called the dissipative work. The Jarzynski equality (|8.7p may be rewritten in this 
case in the original form 

-/5W\ _ ^-/5AF^ ^gg^ 



e > = e 



in which it has become a tool to compute the differences between free energies of equilibrium states from 
nonequilibrium processes [451 1171 1711 172] . 

Example 10. The case of deterministic dynamics 

Upon sphtting the drift ut as in Eq. (16. ip of Sect. 16.21 the expression (|7.6p reduces to Jt — —(V ■■Ut)(xt). 
For the deterministic dynamics where D\-' {x,y) = 0, one has Ut — Ut so that 

Jt = -{V-ut)(xt). (8.10) 

The right hand side represents the phase-space contraction rate along the trajectory Xt, see Eq. (|4.3p . In 
this case. 



1 1 

j iV ■ut){xt)dt = J [^<pt{xt) - {V ■ ut){xt)]dt . (8.11) 



For ifiT — ipo = ifi, the last integral in Eq. (|8.1ip was termed "the integral of the dissipation function" 
in [26]. In the case of the deterministic dynamics (|2.6p obtained from the Langevin equation by setting 
r = 0, the expression (|8.1ip for W reduces to the one of Eq. (|8.8p if we take (fit = P{Ht — Ft). In the 
deterministic case, the Jarzynski equality (|8.7p reads 



/ 



eo e-^^'-^^'dxo = 1 (8.12) 



and may be easily proven directly. To this end recall Eq. (|4.4I) which implies for the deterministic case that 

T 

/ (V ■ «t)(xt) dt — IndetXT(xo), were the matrices Xt(x) of the tangent process are given by Eq. (|4.ip . 



The equality (|8.12p is then obtained by the change of integration variables xq i-^ xt whose Jacobian is 
equal to detXT(xo). 

Example 11. The reversed protocol case 
In the setup of Sect . 16.41 with ut,_ = 0, 

Jt = 2iit(xi) • dt~^(xt) Xt . 
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T 

In the stationary case, the integral J Jt dt, rewritten with use of the Ito convention, was termed an 



"action" in [59], see Eq. (5.3) therein. In 43 , it was considered in the context of the Langevin equation 
with the extra force Gt (but without the Hamiltonian term IlV-fft). It was then identified as /3Q*°' 
with the quantity Q*°* interpreted, following i67j, as the total heat produced in the environment. The 
functional W of the forward process is given here by the formula 

T 

W = A^ + 2j ut{xt)-d;\xt)xtdt = >V*°*. (8.13) 



In particular, for the Langevin dynamics (12. 4p . one obtains: 

T 

W*°' = Aip + pJ {-r\/Ht + UVHt + Gt)(xO ■ r-^xt dt . (8.14) 



The Jarzynski equality (|8.7|l was discussed for this case in mi [73 HQ]. Note that W*°* is not weU defined 
for the Langevin-Kramers dynamics. On the other hand, for the linear Langevin equation of Example 8 

and for ipt = P{H - F), 

T T 

W*°' = P j Xf {C'' + M'^r-^)xtdt = J XfC'^Ur-^xtdt (8.15) 



and it vanishes if IT = 0. A long time asymptotics of the probability distribution of a quantity differing 
from the last one by a boundary term was studied in [80j . 



Example 12. Hatano-Sasa equahty [43] 

In the current-reversal setup of Sect. 16.51 with the splitting (|6.10p of the drift ut induced by the normalized 
densities e~'^* such that ile""^' =0, 

Jt = -(V'Pt){xt)-kt (8.16) 

since now the last two terms on the right hand side of Eq. (|7.6p vanish, compare to Eq. (I7.13p . Upon 
integration, this gives: 



1 



Jtdt = -A<p + {dt'pt){xt)dt (8.17) 



In [33], the integral of Jt given by Eq. (|8.16p was identified in the context of the Langevin equation with 
the force Gt as equal to /JQ*^^ where Q*^^ was termed the excess heat, following [67] ■ The difference 
Qtot_Qex _ Qhk ^g^g called, in turn, the housekeeping heat and was interpreted as the heat production 
needed to keep the system in a nonequilibrium stationary state, see again [67] 43, 77, 10 . Using in the 
definition (|8.2|l the functions ipo and Lpr from the same family, we infer from Eq. (|8.17p that 

T 

yv = f {dt'fit){xt)dt = w^". (8.18) 



The equality (|8.7[l for this case was proven by Hatano-Saso [13], see also [57| . Note that in the stationary 
case, = 0. The Langevin dynamics discussed in Example 9 provides a special instance of the situation 

considered here if Gt = 0. Consequently, in that case, VV°^ is equal to the dissipative Jarzynski work 
(in the units) /3(W - AF) with W given by Eq. (TT^ . 



Example 13. The case of complete reversal 

Recall that for the complete reversal rule of Sect . 16.61 based on the choice of densities e"'''* evolving 
dynamically, Jt is the total time derivative, see Eq. (|7.14p . The use in the definition (|8.2p of the functions 
from the same family annihilates the functional W: 

W =0. (8.19) 
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9 Speck- Seifert equality 



Let us consider the two functionals VV'°* and W*^ of the process xt introduced in Examples 11 and 
12. We shall take them with the same functions ipt satisfying Lle~^* = 0. The two Jarzynski equalities 
^e~^ ^ = 1 = ^e~^ ^ hold simultaneously. In Pffl a third equality of the same type, this time 
involving the quantity 

T 



was estabhshed in the context of the Langevin equation where W'''" = /3Q'''' = /3Q*°' - /JQ"^ is the 
housekeeping heat (in the /3~^ units). We shall prove here a generalization of the result of [T^- To this 
end, let us consider, besides the original process Xt satisfying the SDE (|2.1|l . the Markov process x" 
satisfying the same equation but with the drift ut replaced by 

u't = —fit — dtVift- (9.1) 

We shall denote by ( ■ )" the expectation defined by Eq. (|8.4|l but referring to the process x". Note in 
passing the relations Lj'^e"*^' = 0, where the operators L" are given by Eq. (|3.3p with replacing ut- 
In particular, in the stationary case, the processes Xt and x" have the same invariant measure. 



Proposition 3. 



.Fe-^'- ) = (T) . (9.2) 



Proof. The above identity may be proven directly with the use of the Cameron-Martin-Girsanov formula, 
see Appendix D, by comparing the measures of the processes Xt and x" corresponding to SDEs differing 
by a drift term. Here we shall give another proof based on applying twice the relation (I8.6|l . First, we use 
this relation with the functional replaced by Te~^ for the current-reversal time inversion 

with the trivial involution x* = x and the vector-field rule for vt. This results in the equality 

.Fe-^") = ^^e-w*-+2w-y^ (9 3) 

where the expectation ( ■ pertains to the backward dynamics with 

Ut = -Uf - d/,djipt' , Vt = Vf , 

see Eqs. (|6.1Hl . Now, we observe that the same backward process may be obtained by the reversed- 
protocol time inversion, again for x* = x, from the process x" introduced above. The identity (|8.6p 
applied for the processes x" and x't reads: 

(.^"e-^")" = (.^")', (9.4) 

where 

T 

W" = Aip + 2 ( utixt) ■ dt\xt)xtdt 



is the functional W referring to the dynamics with iit — ut,+ given by Eg. (jg.lf) . The applica- 
tion of Eq. (|9.4p to JT" = jTe"^ '^^^ reduces the right hand side of Eq. (|9.3p to the expectation 
(.7^e-(^'°'-2^""+^"))". The equality ([Ij]) follows by checking that 



T 



2W + W" = Aip + 2 J ut(xt) ■dt\xt)xtdt - 2y {dt'pt)ixt)dt 

f " \ -1 " 

+ Aifi + 2 / [- ut{xt) - dt{xt)'V(fitixt)) ■ dt {xt)xtdt 







= 2Aip - 2 / [dt'^t{xt) + Vipt(xt)-xt]dt = 0. 

□ 
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Setting = 1 in the identity l|9.2p , we obtain the result that was established by a different argument in 
[77) in the context of the Langevin equation: 

Corollary 3 (Speck-Seifert equality). 

(e--") = l. (9.5) 

10 Entropy production 

An immediate consequence of the Jarzynski equality (|8.7|) and of the Jensen inequality (i.e. of convexity 
of the exponential function) is 

Corollary 4 (2"^* law of thermodynamics for diffusion processes). 

(W) > 0. (10.1) 



To discuss the relation of the latter inequality to the 2"^* law of thermodynamics, let us first remark 
that the quantity on the left hand side has the interpretation of a relative entropy. Recall, that for two 
probability measures ^{dx) and v{dx) = e~™'''V('^^)) the relative entropy of v with respect to ^ is 
defined by the formula 

S{^.\i') = j w{x) fi{dx) 

and is always non-negative. Now, the identity (|8.6|) may be read as the relation 

M'(dx) = e-^A/(dx). 

between the measures M{dx) and M' (dx) = A4'{dx). In other words, e~^ is the relative (Radon- 
Nikodym) density of the trajectory measure A/' with respect to the measure M. It follows that 

(W) = S{M\M') 

so that the inequality (|1U.1|I expresses the positivity of the relative entropy. 

Up to now, the measures /io and ht were unrelated. Let us consider the particular case when fix 
is obtained by the dynamical evolution (|3.6p from fio so that fir = IJ.oPo,t- In this case, the relative 
entropy S{M\M') may be interpreted as the entropy production in the forward process between 
times and T, relative to the backward process, see [271 1651 [55] . Let for a measure v{dx) = p{x)dx, 
S{i') = — J In p{x) v{dx) denotes its entropy. Using the definition (|8.2[) . we may rewrite 

(W) = S(AtT) - ^(aIo) + ASen. (10.2) 

where the difference S{pt) — 5(pio) is the change of entropy of the fixed-time distribution of the process 
during the time T and 

T 

ASenv = J {Jt)dt. 


The latter quantity will be interpreted as the mean entropy production in the environment modeled by 
the stochastic noise, measured relative to the backward process. The quantity ( Jt) represents then the 
instantaneous mean rate of the entropy production in the environement. The inequality ([10. ip states 
then that the overall entropy production cannot be negative in mean. In this sense, it is a version of the 
2"^^ law of thermodynamics for the diffusion processes under consideration. In the stationary case, where 
AT = A'o, the overall mean entropy production reduces to the one in the environment ASenv 

Note that ASsnv defined above depends on the time inversion employed (more precisely, on the 
splitting of Ut), and the quantities obtained by employing different time inversions are, in general, dif- 
ferent. They may have different physical relevance. For the Langevin equation with the splitting ([6.7[) . 
AS"'"" _ ^(Q)^ where Q is the heat transfered to the environment given by Eq. ([7.16[) . We may talk 
about the total mean entropy production in the environment ASl'^y if the reversed protocol of Sect. l6.4l 
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and Example 11 is used or about the excess mean entropy production l^Sl^v in the environment for the 
current reversal of Sect. 16.51 and Example 12. The Speck-Seifert equality (19. 5|) combined with the Jensen 
inequality implies that the former does not exceeds the latter. As an illustration, consider the stationary 
Langevin equation with vanishing additional force where AS'li^^ = although ASl°ij, may be non-zero 
if n 7^ 0. In particular, in the linear case studied in Example 8, W'°' is given by Eq. (|8.15p and 

T 

Asini = (w*°*) = I (xfC"^nr"^A/xt)dt = -rtrnr"^M, 



where the second equality was obtained using the SDE (|7.23|l together with the fact that, for the integral 

T 

J Xt • C~^nr~^(^i dt, the Stratonovich and the Ito conventions coincide so that its expectation vanishes. 



Finally, note that for the complete reversal, the overall entropy production vanishes because W = in 
this case, see Eq. (|8.19|l . With our flexibility of the choice of the backward process, there are always ones 
with respect to which there is no entropy production! 

In the deterministic case when Jt is given by Eq. (IS.lOf) . the mean rate of entropy production in the 
environment is 

{Jt) = - ■ '^t){x) nt{dx) 

where Ht is obtained by the dynamical evolution from the measure fio, i-e. Ht = fJ-oPo.t for Po,t(xo, dj/) = 
5{y — Xt)dy. For uniformly hyperbolic dynamical systems without explicit time dependence, the measures 
/it tend for large t to the invariant SRB measure fioo and the mean rate of entropy production in 
the environment converges to the expectation of the phase-space contraction rate —V ■ u with respect 
to fioo [73) . A discussion of the relation between of the phase-space contraction to the production of 
thermodynamic entropy in deterministic dynamics employing models of finite-dimensional thermostats 
may be found in [33] . 

If the measure ht is not obtained by evolving dynamically fio then one has to distinguish between 
the measures ht and fioPo.T- In this case, the relation p0.2p is modified to 

(W) = S(moPo,t) - 5'(mo) + ASe„„ + S(poPo,T)\fiT) , 

i.e. the left hand side is increased by the relative entropy of the measure /it with respect to the 
measure obtained from no by the dynamical evolution. Consequently, the average (W) is minimal when 
= /io-Po,T. 



11 Linear response for the Langevin dynamics 
11.1 Green-Kubo formula and Onsager reciprocity 

As noted in [231 1321 [59] , fiuctuations relations may be viewed as extensions to the non-perturbative regime 
of the Green-Kubo and Onsager relations for the nonequilibrium transport coefficients valid within the 
linear response description of the vicinity of the equilibrium. Here, for the sake of completeness, we shall 
show how such relations follow formally from the Jarzynski equality ([8.7|l for the Langevin dynamics. To 
this end, we shall consider the latter with a time independent Hamiltonian Ht = H and the additional 
time-dependent force 

Gt{x) = gtaC^x), 

where the couplings gta, a = 1,2, are arbitrary (regular) functions of time (and the summation over the 
index a is understood) . In the case at hand, we infer from Eq. (|8.8p that 

T 

W = gtaJ'"{xt)dt for J" = /3(VH) ■ - V • . 



In particular, for the Langevin- Kramers equation ([2.7|l . 

is the power injected by the external force (in the (3^^ units). The quantities J" are often called 
fluxes associated to the forces G". 
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Let us denote by (^T) the expectation defined by Eq. (|8.4|) with /^o standing for the Gibbs measure 
Z~^e~^^ dx and by (^)p the same expectation taken for gta = 0, i.e. in the equilibrium system. 
Expanding Eq. (18. 7p up to the second order in gta and abbreviating J"(xt) = , we obtain the identity 



T T T T 



- J 9ta{J?\dt- j j gtagtb{JtKXdtdt' + \ j j gtagtb{Jt Jt\dtdt' = 0, (11.1) 



where the insertion of the response field TZ^ is defined by the relation 

" Sgta \g = o 

Note that (^JtlZ^,)^ = for t' > t because of the causal nature of the stochastic evolution. The 
vanishing of the term linear in gta in Eq. (|ll.l|l implies that the equilibrium expectation of the fluxes 
vanishes 



dx = , 



which is easy to check directly. Stripping the quadratic term in Eq. (|ll.ip of arbitrary functions gta, we 
infer that 

The integration of the latter equation over t' > results in the relation 

t 

^\ {J?) = f {JtJiXdt', (11.2) 

9 = J 


where on the left hand side we consider the derivative with respect to the coupling gb constant in time. 
In the limit t oo, we may expect the convergence of the expectation ( Jf) in the presence of the time- 
independent force gaC^ (and of its derivatives over gb) to the nonequilibrium stationary expectation 
{JtXt i^^'^ its derivatives). Let us also assume that the temporal decay of the stationary equilibrium 
correlation function of the fluxes is sufflciently fast, e.g. exponential. These may be often established for 
the dynamics governed by the Langevin equation by studying the properties of its generator. With these 
assumptions, Eq. (|11.2p implies 



Proposition 4 (Green-Kubo formula). 

t 

i;\jjnt - 1 {j^Ji'Xdf- 

— oo 



The stationary equilibrium correlation function (j° Jti)^ depends only on the difference t — t' of times. 

Besides, if the system is time-reversible, then (j° Jf^o ~ (■^*' "^"')o ^'^'^ Green-Kubo formula may be 
rewritten in the form 

which implies 



Corollary 5 (Onsager reciprocity). 

sir )st ^ {■^t)sf 
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11.2 Fluctuation-dissipation theorem 

Let us consider again the Jarzynski equality for the Langevin dynamics, this time in the absence of the 
additional force Gt but with a time dependent Hamiltonian 

Ht[x) = H{x) - htaO^x), (11.3) 

where hta, a — 1,2, vanish at t = and 0"(a;) are functions of x ( "observables" ) . In this case, Eq. (|8.8p 
reduces to the relation 

T 

W = J htaO^ixt) - 13 AF, 



where 

PAF = -ln|e-'3(«(^)-''-»°"(^')da; + In J e'^^^^Ux . 



Expanding the left hand side of the Jarzynski equality (|8.7|l up to the second order in hta and abbreviating 
O^ixt) = Ot, we infer that 

l3]hta{Ot\dt - l3hTa{Of,\ = (11.4) 


and that 

T T 



hi?'' 

" 



/ / hta ht>t {01 0\, X dtdt' + I3JJ hta ht,t (O? Rl X dt dt' 



-hP'hTahTb{01,0l\ = 0, (11.5) 

where the insertion of the response field Rf is defined similarly as that of TZt before by 

IJ'Ha I h = 

Again, similarly as before, (O" R^i)q = for t' > t because of causality. 

The first order equality (|11.4p is equivalent to the time-independence of the equilibrium expectation 
of Of. As for the second order relation (|11.5p . upon expressing hta as the integral of hta, it is turned 
into the equality 

PI I hta ht't { (O? Ol - Ot 0,^) )q dtdt' = 2/ / / hta htn^ (O? R\,\ dtdt' dt" . 


After the change of the order of integration over t' and t" followed by the interchange of those symbols, 
the right hand side becomes 

2jJJhta ht>b <0? Rt")o dtdt' dt" = 2/ // hta k't 0{t - t') (O? Rl„\ dtdt' dt" 

t' t> 

with the use of causality. Stripping the resulting identity of the integrals against arbitrary functions hta, 
we obtain the identity 



P{OtOl\ -i3{o'^o't,X = e{t~t') j\otRl.\dt" + e{t' ~t) j\ot,R't,\ 



dt" 



which is the integrated version of the difi'erential relation between the dynamical 2-point correlation 
function and the response function: 

Proposition 5 (Fluctuation-dissipation theorem). For t > t' , 

~dt{OtOl\ = l3-\OtR\,\. (11.6) 



Note the explicit factor /3 in this identity. Relations between the dynamical correlation functions and 
the response functions were used in recent years to extend the concept of temperature to nonequilibrium 
systems [20] [Ti] . 
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12 One-dimensional Langevin equation with flux solution 



Let us consider, as an illustration, the one-dimensional Langevin equation of the form 

i = -d^Htix) + (12.1) 

with (CtCf) ~ '2P~^S{t — t') (any force is a gradient in one dimension). As before, Xt will represent 
the Markov process solving the SDE (|12.ip . First, let us consider the time-independent case with a 
polynomial Hamiltonian H{x) — ax'' + . . . with a 7^ and the dots representing lower order terms. 

• If fc = then, up to a linear change of variables, xt is a Brownian motion and does not have an 
invariant probability measure. 

• If fc = 1 then Xt + at is, up to a linear change of variables, a Brownian motion and Xt still does 
not have an invariant probability measure. 

• If fc > 2 and is even then for a > the Gibbs measure /io {dx) = Z-^e-'^^^'^'^dx provides the 
unique invariant probability measure of the process xj. It satisfies the detailed balance condition 
j{x) = 0, where j{x) is the probability current defined by Eq. p.8|) . If a < 0, however, then the 
Gibbs density e"*^^'"^' is not normalizablslll- In this case, the process xt escapes to ±00 in finite 
time with probability one and it has no invariant probability measure. 

• If fc > 3 and is odd then the Gibbs density e"*^^'"^' is not normalizable. The process Xt escapes in 
finite time to —00 if a > and to -l-oo if a < 0, but it has a realization with the trajectories that 
reappear immediately from ±00. Such a resuscitating process has a unique invariant probability 
measure 

X 

^io{dx) = ±iV-i (e"''-^'"' J e^-^'^'dyjdi = e-*'°'">da; (12.2) 

Too 

with the density e"*^"'^' — 0{x~'''^^) when x ±00 and the (positive) normalization constant. 
The measure no corresponds to a constant probability current j{x) = iiz{pN)~^ and the model 
provides the simplest example on a nonequilibrium steady state with a constant flux. 

Let us look closer at the last case. Adding the time-dependence and taking (pt as in Eq. p2.2p but with 
Ht replacing H, we obtain the Hatano-Sasa version of the Jarzynski equality (|8.7|) with W — VV^^ given 
by Eq. (|8.18|l . Suppose, in particular, that the time dependence of Ht has the form (lll.3[) with functions 
O" having compact support. Let us introduced also the deformed observables 

/ 0''iy)e'^"'-y'> dy 

0-(x) = . 

/ ePH^y)dy 

Expanding the Jarzynski identity (|8.7p to the second order in hat as in Sect . 111. 21 one obtains: 

Proposition 6 (Deformed fluctuation-dissipation relation). For t > t' , 

-dt{AtO't\ = r\AtR't>X Timr' lidxO'){x)dxPt^t'{x,dy)A^iy), (12.3) 
where Pt{x, dy) is the transition probability in the stationary process and A" = O" — O". 

Remark 3. It is easy to show directly, that Eq. (|12.3p still holds if A"" is replaced by O". Note that 
the term on the right hand side of (|12.3|l violating the standard fluctuation-dissipation theorem pi.6p 
contains the constant flux of the probability current j{x) as a factor. Proof of Proposition 6 and of its 
version with ^4" replaced by O" will be given in [12] . 

The Langevin equation p2.ip with the flux solution arises when one studies the tangent process for 
particles with inertia moving in the one-dimensional homogeneous Kraichnan ensemble of velocities vt (y) 
with the covariance 

{vt{y)vs{y')) = 5{t ~ s) D{y - y') , 

*This leads to the breaking of the quantum-mechanical supcrsymmctry underlying the Fokker-Planck formulation of 
the Langevin dynamics [HI \M\ [79] . 
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see Example 2. The position y and the velocity w of such particles satisfy the SDE [3] 

y = w, w ^ ^{-w + vt{y)) , 

where r is the so called Stokes time measuring the time-delay of particles with inertia as compared to the 
Lagrangian particles that follow the flow. The separation between two infinitesimally close trajectories of 
particles satisfies the equations ,^83j 

= 5w, ±5w = ^{-5w+{dyv,){y)5y) (f2.4) 

and, similarly as in Example 5, we may replace ^dyVt{y) on the right hand side by a white noise C,{t) 
with the covariance 

(CtC.) = -5{t^s)T-^D"{Q), 

where the primes denote the spatial derivatives. The ratio x — ^ satisfies then the SDE 

X = -x^ - '^x + Ct (12.5) 

which has the form (|12.ip with H{x) — ^x^ + -^x'^ , a third order polynomial. The solution with the 
trajectories appearing at +00 after disappearing at —00 corresponds to the solution for {5y, 5w) with 
5y passing through zero with positive speed. The top Langevin exponent for the random dynamical 
system (|12.4p is obtained as the mean value of x (which is the temporal logarithmic derivative of \5y\) 
in the invariant probability measure (|12.2p with constant flux [83j . 

A very similar SDE arose earlier [41] in the one-dimensional Anderson localization in white-noise 
potential V(y) where one studies the stationary Schrodinger equation 

-r{y) + V{y)^{y) = E^{y). 

By setting x = ^p' one obtains then the evolution SDE 

x' = ~x^ - E + V{y) . (12.6) 

that has an invariant probability measure with constant flux, as already noticed in [41) . The expectation 
value of X in that measure may be expressed by the Airy functions [ST]. It gives the (top) Lyapunov 
exponent which is always positive, reflecting the permanent localization in one dimension. The SDE (|12.5[) 
may be obtained from (112. 6|l but taking in the latter E = —^n and by the substitutions x — ^ x, 
V and y t-^ t. This shifts the Lyapunov exponent down by — ^ and the top exponent for the 

inertial particles may have both signs [83[ . 



13 Detailed fluctuation relation 

For a general pair of forward and backward diffusion processes (|2.ip and (|5.4I) . it is still possible to obtain 
identities resembling the generalized detailed balance relation (|7.15|l at the price of adding constraints 
on the process trajectories. Let us introduce a functional W' of the backward process by mimicking the 
definition (|8.2|l of W for the forward process: 

T 

W ^ Aif' + J Xdt 


with 

X = 2Ui,+ (xi) • di"^(xi)Xi - 2ut^j^{xt) ■ d't~^{Xi)u't_{xt) ~ (V-Ut_)(xt), 
see Eq. (|7.6|l . Since the time inversion is involutive, the mirror version of the identity (|8.3|l , 

^i'oidx') E% T'{x') e-^'f"'' dy' = /io(dy'*) iS^;^,,. ^'(x) dx'* dx" , (13.1) 

must also hold. Taking x' — y*, y' = x* and T' = T , we infer that the compatibility of identities 
(|8.3[l and (|13.1|) imposes the equality 

W = -W, (13.2) 
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which may be also checked directly. We infer that, whatever the time inversion used in their definition, the 
entropy-production functionals W for the forward and the backward processes are related by the natural 
time inversion. The replacement in Eq. (|8.3|l of the functional JF(x) by the functional J-{>(.) 5(W(x) — W) 
including the constraint fixing the value of W, leads then to 

Proposition 7 (Detailed fluctuation relation). 

fio{dx) El'l .^(x) 5(W(x) -W) dy = fi'oidy") e^ E'°:'^, 5(W'(x') + W) dx* . (13.3) 

The primes on the right hand side may be dropped in the time-reversible case if, additionally, <^o = f'o 
and ifT = ^'t- 

□ 

A relation of this type, named the "detailed fiuctuation theorem", was established in [5T] in a setup of the 
Hamiltonian dynamics. It is close in spirit to the earlier observation made for the long-time asymptotics 
of deterministic dynamical systems in [31]. We shall view Proposition 7 as a source of fluctuation relations 
that hold for the diffusion processes 1)2. 1[> . including the Jarzynski equality l|8.7[) already discussed and 
various identities that appeared in the literature in different contexts, see |51l 1181 1191 [57] . Taking, in 
particular, = 1 in Eq. (|13.3|) and introducing the joint probability distributions of the end-point of the 
process and of the entropy production functional W, 

El'l5{W{x)~W)dydW = Po,T{x,dy,dW), E'^^:^ S{W' {^) ~ W) = PiT{x,dy,dW') , 

we obtain 

Corollary 6. 

^lo{dx) Po,T{x,dy,dW) = firidy) e"^ P!,^T{y\dx*,d{-W)). (13.4) 

This may be viewed as an extension to a general diffusive SDE (|2.H) of the detailed balance relation p.9p . 
or of its generalization (|7.15|l . In particular, when the backward process is obtained by the complete 
reversal of Sect. (|6.6|l with W = 0, the latter relation reduces to Eq. (|7.15p with both sides multiplied by 
6{W)dW. 

In the case when the measures fio and /xq are normalized. Proposition 7 gives rise, upon integration 
over X and y, to a detailed fiuctuation relation between the forward and the backward processes with 
the initial points sampled with measures and /ig, respectively: 

Corollary 7. 

Finally, taking T — 1 in the latter identity and denoting 

Po,T{dW) = (^5{yV ~W)'^dW , p'o,TidW') = ^ 5(W' - W') J dW' , 

we obtain 

Corollary 8 (Crooks relation) [151 [15] . 

Po,T{dW) = e"" p'o,Tidi~W)) . (13.5) 

Note that po,T(rfVK) is the distribution of the random variable W if the time-zero values of the forward 
process Xt are distributed with the measure /xo and, similarly, p'Q j,(^dW') is the distribution of the 
random variable W' if Xq is distributed with the measure fig. In particular, in the time-reversible case, 
p'QT{dW) = po,T{dW) if ip'g — (fio and (f'rp = tpr- Finally, note that integrating the Crooks relation 
(|13.5p multiplied by e~^ over W, one recovers the Jarzynski equality (|8.7|l . 
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14 Special cases 



14.1 Deterministic case 



As already explained in Sect . 16. 21 and 13, taking ut,+ — and ut,- = iit leads in the limit of the 
deterministic dynamics (|2.3p to the expression (|8.1H) for W. The time-reversed dynamics corresponds 
to the vector fields of Eqs. (|6.2|l . It reduces in the deterministic case to the ODE (|6.3|l . The functional 
W' of the backward process, that could be also found from the relation (|13.2p . takes the form 

T 



In the deterministic limit, this simplifies to the expression 

T 



which is of the same form as Eq. (|8.1ip for W. Proposition 7 and Corollaries 6,7 and 8 still hold 
in the deterministic limit. In particular, in the time-reversible deterministic case with u — u and 
fT — fo = 'fi'o, the fluctuation relation (|13.5|l reduces to 

Corollary 9 (Evans-Searles transient fluctuation theorem) [251 126] 

PoAdW) = po,T{d{-W)). 

The latter relation may also be proven directly by a change of the integration variables xq i--> xt [26] . 

14.2 Reversed protocol case 

For the reversed protocol time inversion of Sect. l6.4l and Example 11 that corresponds to the choice ([6.8p . 
the backward process is given by Eq. ([6.9]) and 

T 

' dt 



1 



and has the same form as W, see Eq. ([8.13[l . For such a time inversion with x* = x, employed already in 
the stationary context in [59] . the fluctuation relation ([13.5[l for the choice of ift such that L\e~'^^ — 
was established in |10|. 

14.3 Current reversal case 

For the time inversion ([6.10[l discussed in Sect . 16.51 and Example 12, the functional W' of the backward 
process is given by the expression of the same form as Eq. ([8.18^ : 

T 



for ^p'tix) = {tfit* -\-\n(j)(x*). The fluctuation relation ([13.5[l for this type of time inversion (with x* = x) 
was proven by in [TO]. Integrated against e~^, Eq. ([13. 5p reduces to the Hatano-Sasa case of the Jarzynski 
equality ([8.7p that we discussed in Example 12. 



14.4 Langevin dynamics case 



Recall that for the Langevin dynamics ([2.4p . the backward process obtained by using a canonical time 
inversion defined by Eqs. (]6.6p and (]6.7p is also of the Langevin type with 

u[ = -VVH', + nVH't + G't , (14.1) 

where H[{x) = Ht*{rx), G't{x) = —rGt*{rx). The white noise = ±''0* has the same distribution as 
("t. Consequently, for (p'f = l3{H't — Ft), the functional W' is given by the primed version of Eq. (18. 8p 
and is equal to the dissipative work (in the /J~^ units). 
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If, instead of the canonical time inversion, we use the reversed protocol with x* = x then the backward 
process is again the Langevin dynamics with u't given by Eq. I|14.1|) . except that this time H't{x) = Hf {x) 
and G't{x) = Gt'{x). The white noise C,i = 0* has again the same distribution as C^t- The functional 
W' is given in that case by the primed version of the Eq. (|8.14p . The two time inversions lead to the 
equivalent backward processes for the Langevin-Kramers equation but, as already mentioned, W*°* is 
not well defined in the case of the reversed protocol. 

Finally, if we apply the current-reversal time inversion (|6.10|l with x* = x to the Langevin dynamics 
113} with = by setting ipt = P{Ht - Ft) = (^J. = - F/.) for H[{x) = Hf{x), the drift of 

the backward dynamics becomes 

u't = -rviJt' - nvH'-t 

and has the changed sign of the antisymmetric matrix 11 with respect to the forward process. The white 
noise C,i ~ ±Ci* • Here both W and W' have the form of the dissipative work. 

15 Transient versus stationary fluctuation relations 

The fiuctuation relations considered up to now dealt with the quantities related to finite-time evolution 
in a random process that, in general, was not stationary. Such simple relations, whose prototypes where 
the Evans-Searles fiuctuation relation [25] or the Jarzynski equality [IS] are called transient fiuctuation 
relations. On the other hand, as was recalled in Introduction, Gallavotti and Cohen have established in 
[35) a fluctuation relation for quantities pertaining to the long-time evolution in stationary deterministic 
dynamical systems of chaotic type and similar relations were subsequently obtained for the Langevin 
dynamics and Markov processes in [57] and [59]. Such fluctuation relations, that are commonly termed 
stationary, are usually more difficult to establish than the transient ones and require some non-trivial 
work that involves the existence and the properties of the stationary regime of the dynamics. Such 
properties are in general harder to establish in the non-random case than in the random one. Also, in 
the random case, the invariant measure of the process, if exist, is usually smooth. It could be used as the 
measure fio{dx) — e~^°''^'^dx = fiT{dx) = ^'^idx*) in the definition (|8.2|l . leading to the exact detailed 
fiuctuation relation (|13.3[) pertaining to the stationary evolution. On the other hand, in the dissipative 
deterministic systems, the invariant (SRB) measures are not smooth, so that they may not be used this 
way and the exact stationary fiuctuation relations may be obtained only in the asymptotic long-time 
regime. Let us discuss briefly a formal relation between such asymptotic fluctuation relations and the 
transient ones, sweeping under the rug the hard points. 

We shall consider the stationary case of the SDE (|2.ip . with Ut = u and Dt{x,y) = D{x,y). Under 
precise conditions, the Markov process xt that has decaying dynamical correlations and attains at long 
times the steady state independent of the initial (or/and final) position [421155] . In such a situation, the 
distribution of the functional W is expected (and may often be proven with some work) to take for long 
time T and for W/T = 0(1) the large deviation form 

Po,T{x,dy,dW) oc e''^'^'-'^^^^ dydW (15.1) 

independent of x and y. The function ^ is called the large deviations rate function. It is convex and 
has vanishing minimum. More exactly, the relation (|15.1[) means that 

-supC(w) < lim iln Po^T{x,y\W) dW 

TI 

< lim iln / Po,T{x,y\W)d-W < - inf C(w) 

T — *oo P J w^I 
TI 

for any interval X in the real line. In particular, in the limit T — > oo, the distribution of W/T 
concentrates at the non-random value wo where the rate function ^ attains its minimum. With similar 
assumptions about the inverse process, we shall denote by the large deviation rate function of the 
functional W'. The detailed fluctuation relation (|13.4p implies then immediately, if the boundary term 
'p'o{y*)/T ~ (ifTiy) +lna{y))/T converges to zero when T ooO, a relation between the rate functions 
C and C- 



Corollary 3 (Stationary fluctuation relation). 

C(io) = C'i~w) - w (15.2) 
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Eq. (115. 2p connects the statistics of large deviations of W for the forward and for the backward stationary 
stochastic processes. Note that the equality C' ^ implies that the asymptotic value wo of W/T is non- 
negative. This conclusion may be also drawn from the 2"^* law (|1U.1|I . In the special case of a stationary 
time-reversible dynamics, the inverse process coincides with the direct one so that ^' = ^. Eq. p5.2p 
compares then the large deviations of W/T of opposite signs in the forward process. In particular, it 
states that the probability that W/T takes values opposite to the most probable ones around wq is 
suppressed by the exponential factor e~'^^o for large times T. 

T 

Recall from the definition (|8.2|l that W differs from the extensive quantity J J7t dt by a boundary 



term which should not contribute to the large deviations if ipr stays bounded, although presence of 
such terms may change the time-scales on which the large deviation regime is effectively visible. On the 
contrary, unbounded ipr may give contributions to the large deviations statistics [821 [9l 1851 169) . For 

T T 

the deterministic dynamics where J Jtdt — — J{V ■ u){xt)dt is the phase-space contraction along the 



trajectory, see Eq. (IS.lOf) . the identity (|15.2|l with (' — ( is essentially the original Gallavotti-Cohen 
fluctuation relation [351 131[ established rigorously by the authors for the reversible Anosov dynamical 
systems with discrete time. For such systems, the thermodynamic formalism [741 134) may be used to 
prove the existence of the stationary (SRB) measure and of the large deviations regime for the phase- 
space contraction, see also 73 for a somewhat difi^erent approach. In i56|, the fluctuation relation ()15.2[) 
was discussed for the Langevin-Kramers dynamics, see also [591 157) . Its version considered here for a 
general stationary diffusion process is equivalent in the case of vanishing time-inversion-odd drift it_ to 
the fluctuation relation discussed in [59], see Eq. (5.8) therein. 

As another (although related) example of how the transient fluctuation relations yield stationary ones 
involving large deviations, let us recall the case of the tangent process in the homogeneous Kraichnan 
model leading to the Ito multiplicative SDE ()7.8|l (or the Stratonovich SDE ()7.10p equivalent to it) and 
defining the matrix- valued process Xt. We have established for it the transient fluctuation relation ()7.12p 
that may be rewritten as the identity 

E° det(XT)/(XT) = eUI^t')- (15.3) 

for functions / of real dx d matrices with positive determinant. Such matrices X may be cast into the 
form 

X = 0'diag(e''\...,e'''')0"^ (15.4) 

with a diagonal matrix of non-increasing positive entries sandwiched between two orthogonal ones. Note 
that IndetX — "^Pi- The so called stretching exponents pi > ■■• > Pd are uniquely deflned by 
Eq. ()15.4[l . Consider functions f{X) that are left- and right-invariant under the action of the orthog- 
onal group 0{d). They may be viewed as functions of the vector p of the stretching exponents. The 
distribution Pridp) of such exponents is defined by the relation 

</(Xt) = I mPridp). 

pi>-->Pd 

The identity ()15.3[l implies then that 

Pridpje^"^ = PT(d(-p)), (15.5) 

where —p = {~Pd, ■ ■ ■ , —pi) is the vector of the stretching exponents of the matrix X^^ . In few particular 
situations (e.g. in the isotropic case), it has been established that for long times and p/T = 0(1), the 
distribution of the stretching exponents takes the large deviation form 

Pridp) (X e-'^^'^'/'^'dp 

and the identity ()15.5p implies then the stationary fiuctuation relation 

d 

Z{a) - = Z{-B), (15.6) 

i = l 

see [11| . Since —^pi represents the phase-space contraction — IndetXt in the Kraichnan model, the 
relation (115. 6[l may be viewed as a modified Gallavotti-Cohen identity ([15.2)1 for the homogeneous Kraich- 
nan model. The modification goes in two directions. On one hand side, the original Gallavotti-Cohen 
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relation involved the deterministic dynamics, whereas the relation (|15.6[) pertains to random Kraichnan 
dynamics. On the other hand, it refers to the "multiplicative" large deviations for the vector p of the 
stretching exponents containing more detailed information than the phase-space contraction represented 
by pi- For example, the most probable values of the stretching rates Oi = pi/T for which 

Z{a) = define the Lyapunov exponents \i whereas the most probable phase-space contraction rate 
is equal to the negative of their sum. We shall see in the next section how to extend such multiplicative 
fluctuation relations to the general diffusive processes. The source of such an extension resides in tran- 
sient relations that may be proven for general random or deterministic dynamical systems by a simple 
change-of- variables argument a la Evans- Searles as first indicated in [I]. 



16 Multiplicative fluctuation relations 



As we have mentioned above, the SDE ^2.1} defining the diffusive process xt may be used to induce 
other diffusive processes, the simplest example being the tangent process (xt,Xt) introduced in Sect.|3] 
and satisfying the SDEs 

i = ut{x) + vt{x), X = Ut{x,X) + Vt{x,X) 

with 

Ui,{x,X) = {duu\){x)X'',, Vi,{x,X) = 
see Eq. (|4.2|l . The covariance of the white noise vector field [vt, Vt) is given by the relations (|2.2|l and 

{vl{x)V^,{y,Y)) = 5{t~s)dyr.Dl\x,y)Y'-i, 

{Vr,{x,X)vi{y)) = 5{t~s)d.r.DT{x,y)X\, 

(K^(x,X)\/^(^/,F)> = 5{t-s)d.^dyr.Df{x,y)X\Y"l. 

One may now apply the theory developed above for general diffusion processes to the case of tangent 
process. As an example, let us consider the natural time inversion of Sect . 16.11 corresponding to the trivial 
splitting 

(ut,+, Ut,+) = 0, {ut,-, Ut,-) = {ut, Ut) 

and to the involution 

{x,X)* ^ {x*,X') with {X*y J = {dkx"){x)X''j . 
The backward process {xt,X't) satisfies in this case the SDE 

X' = u'tix') + v'tix'), X' = UUx',X') + V;{x',X') 



with 



and, similarly. 



Ut{x) = -{dkx"')(x'')ul,{x') , 

U[{x,X) = -{dkd^x"){x') {X*r^u%{x') - {d,^x"){x*)U'?,{x\X*) 

= {dnUt){x) X'^j 

vt{x) = ±{dkX*^){x*)vt.{x*) , Vl{x,X) = {dnVt){x) X'^j . 



Note that the backward process (xJjXj) defined this way coincides with the tangent process of x^. 
Eqs. (|3.4|l applied to the case at hand give: 

(uj,+ (x), {Ut,+)\{x,X)) = _£±i(a,.i3'"(x,y)|,=., 

^ „£±irn (X-^Y\( dyr.Df{x,y)\y=^X^i 

2 ^""'^ > ^' \d^^D^,\x,y)\y=^X\ d^^dy..Df{x,y)\y^^X\X-^i 

in the matrix notation, where the matrix on the right hand side is the counterpart of {d\^ {x)) for the 
tangent process. Substituting the above expression to the definition (|7.6p . we infer that 

Jt = -(d+l)(X7')'-pXL + (d+l)(Xr^rp9„<(xt)Xr. - (d+l)9„<(xO 
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= -(d+ 1) — IndetXt . 

The relation (|L2ll of Sect .[7] gives then for the case of the tangent process the identity 

dxdXo Po,T{x,Xo;dy,dX) (detXo)~<''+^'(detX)'*+^ = dy dX Po^j-iy' , X* ■ dx* , dXg) 

that may be viewed as an extension of the relation (|7.1ip obtained in Example 5 for the homogeneous 
Kraichnan process to a general diffusive process. Similarly as in Example 5, we infer from the above 
equation the multiplicative fluctuation relation 

dx Po,T{x,l-dy,dX){detX) = dy Po.riv* A* ; dx* , d{X-'^)*) . (16.1) 

Suppose that we are given a Riemannian metric 7 on R"^ (for example the usual flat one). Since the 
matrix X = Xt maps the tangent space at x = xq to the one at y — xt, see Eq. (|4.2|l . it is natural to 
define the stretching exponents p of X by the relation (|15.4|l with O and O' mapping the canonical 
basis of R'^ into a basis orthonormal with respect to the metric 7(2;) and 7(1/), respectively. The joint 
probability distribution Po,t(2;, dy, dp) of the end-point of the process Xt and of the stretching exponents 
of Xt is then given by the relation 

J f{X) Po,T{x,l,dy,dX) = J f(p} Po,T{^,dy,dp) 

pi>-->Pd 

for functions f{X) left- and right-invariant under the action of the orthogonal groups preserving, re- 
spectively, the metric 7(2;) and 7(1/). Similarly we introduce the kernels Pq y (2;', dy', dp*) using the 
transition probabilities of the backward process and the metric 7' obtained from 7 by the involution 
X 1-^ X* . Eq. (|16.ip implies then the identity 

v^{dx) Po^T{x,dy;dp) e^''' = v^{dy) PQ^T{y,dx*;d{-p)) . 

where v-y (dx) is the metric volume measure. For the stationary dynamics, we may expect the emergence 
of the large deviations regime for the stretching rates with 

Po.T{x,dy-dp} ^ e-'^^'^'/'^'dj/dp 

for large T and p/T = 0(1), and similarly for the backward process. One obtains then the identity 

d 

Z{S) ~ ^cr» = Z'{-5). (16.2) 

i = l 

As usually, the rate function Z' for the backward process may be replaced by Z for a time-reversible 
dynamics. The relation (|16.2p generalizes the fluctuation relation (|15.6|l obtained for the Lagrangian flow 
in the homogeneous Kraichnan model that was time-reversible. The multiplicative fluctuation relations 
were studied recently in [30] also for particles with inertia carried by the homogeneous Kraichnan flow. 
Due to the Stokes friction force, the standard time-reversibility is broken in such a system, leading to a 
modification of the relation between the rate functions Z' and Z. 



17 Towards A^-point hierarchy of fluctuation relations 

Another way to induce new diffusive processes from the original one described by the SDE (|2.1|l is to 
consider simultaneously its solutions starting at different initial points. They may be viewed as a 
solution of the SDE 

X = ut{x) +vt{x) (17.1) 

with X = (a;i, . . . , a;jv), Ut{x) — {ut{xi), . . . ,ut{xN)), and Vt{x) — {vt{xi), . . . ,vt{xM))- The covariance 
of the white noise vector field Vt = {vt,i, ■ ■ ■ , t't.jv) appearing on the right hand side is 

(Wt,m(a;)fs,n(y)> = 5{t~ S) Dmx„,yn) ■ 

The spatial part of the covariance restricted to the diagonal is 

The machinery producing the fluctuation relations described in this paper may be applied to the A-point 
diffusion process governed by the SDE (|17.ip . at least if the matrix (dj^„„(a;)) is invertible, recall that the 
inverse of the matrix (dj"'(a;)) appears in the expression (|7.6p for Jt. We postpone a closer examination 
of the possible hierarchy of fluctuation relations obtained this way to the future. Here, let us only remark 
that the tangent process (xt, Xt), which was studied in the preceding section and led to the multiplicative 
fluctuation relation (|16.ip . could be viewed as a limiting case of the (d -f l)-point process where the last 
d points are infinitesimally close to the first one. 
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18 Conclusions 



We have developed a unified approach to fluctuation relations for finite-dimensional diffusion processes. 
The setup of the paper covered the cases of deterministic dissipative continuous-time dynamical systems, of 
the Langevin dynamics with non-conservative forces, and of the Kraichnan model of hydrodynamic flows. 
The fluctuation relations were obtained by comparing the forward diffusion process to the backward one 
produced by a time inversion. We have admitted different time inversions that treated differently two parts 
of the deterministic drift in the diffusion equations. This was physically motivated in situations when one 
part of the drift was assimilated with a dissipative and another one with a conservative force, but was used 
in other situations as well, leading to a greater flexibility. As particular cases, we discussed the natural time 
inversion used for deterministic systems, its slight modification for stochastic dynamics that permitted to 
take easily the deterministic limit of fluctuation relations, as well as the reverse protocol and the current 
reversal discussed in a similar context in 10 , and the complete reversal. We showed that any of the 
allowed time inversions leads to a detailed fluctuation relation (|13.3p of Proposition 7 that may be viewed 
as a constrained version of the generalized detailed balance relation to which the relation (|13.3p reduces 
in the case of the complete reversal. The constraint fixes the value of the entropy production measured 
relative to the corresponding backward process. We obtained various transient fiuctuation relations as 
corollaries of the detailed one. Among examples were the Evans-Searles fluctuation relation (|14.ip . the 
Crooks one p3.5|l . and various versions of the Jarzynski equality (|8.7p . including the original ones for 
the deterministic Hamiltonian dynamics and for the Langevin dynamics with local detailed balance (|8.9|) . 
the one for reversed protocol, and the Hatano-Sasa one. By comparing the detailed fluctuation relations 
for two different time inversions, we obtained also a generalization (19. 2p of the Speck-Seifert equality 
(|9.5|) . For the sake of completeness, we included into the paper a derivation from the Jarzynski equality 
of the Green-Kubo and the Onsager relations, and of the fluctuation-dissipation theorem. On a simple 
example of a one-dimensional Langevin equation with spontaneously broken equilibrium, we indicated 
how in such a situation the Hatano-Sasa version of the Jarzynski equality induced corrections to the 
fluctuation-dissipation theorem proportional to the flux of the probability current. 

In the case of stationary diffusion processes, we pointed out that the transient fluctuation relations 
may give rise to the asymptotic symmetries of the large-deviations rate function of the entropy production 
which were established first by Gallavotti-Cohen for the uniformly hyperbolic dynamical systems and were 
extended later to (some) diffusion processes by Kurchan and Lebowitz-Spohn. Finally, we wrote explicitly 
a detailed fluctuation relation for the induced tangent diffusion process obtained from the original one. 
This produced a multiplicative transient fluctuation relation that led for long times to a Gallavotti- 
Cohen-type symmetry of the large-deviations rate function for the stretching exponents governing the 
behavior of infinitesimally close trajectories of the diffusion process. We speculated that considering 
distant multi-point trajectories of the process should give rise to a hierarchy of fluctuation relations. It 
could also provide a way to produce fluctuation relations for flow processes describing the simultaneous 
evolution of all trajectories of the process [55) . A similar extension should also permit to formulate 
fluctuation relations for hydrodynamic flows modeling fully developed turbulence [401 16U) . We postpone 
such questions to further studies. 

Appendix A 

The Stratonovich SDE ([2.1|l defining the process xt is equivalent to the Ito SDE 

dx^ = (ul{x) + ul{x)'^ dt + vl{x)dt, 

with the correction term 

By the Ito calculus, g(xt) satisfies the Ito SDE 

dg{x) — (ul{x) + ul{x))dig{x) dt + vl{x)dig{x) dt + ^d\^ {x)didjg{x) dt . 
with the second order Ito term. For the expectation of g{xt), this gives the ODE 

^^El°g{xt) = El° {ul{xt)+ul{xt))^^g(xt) + '-dl' {xt)d,d,g{xt) 
from which the formula 

Lt = [ut + Ut{xt)) di + \d\'didj, 
easily seen to be equivalent to Eq. p.3[) . follows. 
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Appendix B 

Proof of Lemma 1. 

{Lt,-Rg){x) = ul_{x)di{Rg){x) = ut__{x){diX*'")(x){dkg){x*) 
= -{ut'idkg){x*) = -{RLt*^^g){x) , 

{Lt,+Rg){x) = ul+(x)d,(Rg){x) + {x)d^{Rg){x) 

= Ut^+{x){diX*''){x){dkg){x') - \dy,D''^{x,y)\y^x{diX*^)(x)(dkg){x*) 

+ \{d3x''^){x)d^,id\^{x){dix''^){x){dkg){x'') 
= {uf,^+dkg){x*) - ^idjx''''){y)dy,iD'^ {x,y)\y^x {dix''''){x){dkg){x*) 

-'^{d^,.d,x*\x))dl^ix)id.x*'')ix)idkg)ix') 

+ ^9^" {djx*'){x)dt'{x){dix''''){x){dkg){x*) 
= {u't- ,+dkg){x*) - \dy,i {djx'^){y)Dl^{x,y){d^x''''){x)\y=x{dkg){x*) 

+ \d^,id't,\x*){dkg){x') 
= {u%,+dkg){x*) + '-{did'fi'dkg)ix') = {RL',,^+g)ix), 

where we have used the relations (|3.4|l . (15.51 (|5.6|l and (|5.7p . 

□ 

Appendix C 

In order to prove the first of the equalities (|6.2p . let us note that the condition ut,+ = means that 

ul+{x) = ^dyjDl^{x,y)\y^x 

so that, according to Eqs. (|5.5|) and (|5.6|l . 



".,+ (2;*) = (afea::")(a::)iaj^ii3"(2:,y)l!/=3; 

= (9ja;*")(t/*)(a;a::*^)(y)(9fta;")(a::)Df (x,j/)|j;=^ 

= |(9:ia;*")(?/*)9y« (afca;")(x) A'''(a;, 2/)(aa;*^)(y) |y=^ 
+ '^{d.Adjxnix')){dkxn{x)d'^'{^)idix''){x) 
= k^yi^t*^^*'y'>\y=^' + |(9na;*'')(2;)(afc9ja;*")(a;*)d;!/(x*) 



where we used the identity 



to obtain the last equality. The first of the relations in Eqs. (|6.2I) follows. The second one is an immediate 
consequence of the transformation rule in Eqs. (|5.5|l . 



{djlna){x*) = {dnX*''){x){djdkX*'^){x*) 



Appendix D 

Proof of Lemma 2. The Cameron-Martin-Girsanov formul43 says that if yt is the diffusion process 
solving the SDE 

y = wt{y) + ut{y) + vt(y), (D.l) 

then 



^We have transformed the formula usually written in the Ito convention [78] to the Stratonovich one. 
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for xt solving the SDE (|2.ip and 

t 

U{x) = y [- Ws(Xs) ■ dJ^{Xs)-ks + Ws{Xs) ■ dJ^{Xs)Us{Xs) 

to 

+ ^Ws{Xs) ■ dJ^{Xs)Ws{Xs) + ^{V ■ Ws){Xs)^ds 

if the functional JT depends on the process restricted to the time interval [to,il- The first term under 
the integral in the expression for U{x) has to be interpreted with the Stratonovich rule. Denoting by Lt 
the generator of the process yt solving the SDE (|D.ip . 



Lt = {w't + Ut)di + \djd\^di , 

we obtain this way the relation 

t 

Pt„tix, dy) = El« S{yt - y) dy = T exp [ ^ ds] {x, dy) = E'J> e-^W S{xt -~ y) dy . 

to 

Next, if ft{x) is a time-dependent function then, by the Feynman-Kac formula, 

T expU {Ls- fs)ds^{x,dy) = Ei° e 'o S{xt ~ y) dy . 



to 

The application of the latter formula for wt — ~2ut,+ and ft ~ — V ■ fit,+ + V ■ iit,_ gives Eq. (|7.5|) in 
view of the relation (|7.H) . 

□ 



Appendix E 

Here we show that the matrix M given by Eq. (|7.29|l . where F and C are strictly positive and 11 is 
antisymmetric, has eigenvalues with negative real parts and that the matrix C may be recovered from 
Eq. (|7.25p by setting t — oo. If A is an eigenvalue of M, i.e. if 

for some x\ ^ then 

. _ -xx-c~\r~n)c-'xx -xx-c-^rc-^xx ^ 

XX -C ^xx XX- C ^xx 



Eq. (rr29|l implies that 



MC + CM^ = -2V 



which is solved by Coo given by Eq. (|7.25p with t = oo. Besides, this is the unique solution because if 
MD + DM'^ = then 

d tM r-i tAf^ rv 

— e De =0 

dt 



and 



_D = lim e De — . 



Appendix F 

Proof of Proposition 2. It is enough to check the last identity for the so called cylindrical functionals 

T{x) = f{xt^,...,xtj 

for < ti < ■ ■ ■ < tn < T. Since 

, . , , - J Jsds - I Jsds - f Jsds 

e = e'^''^''°^e « e 'i • • • e *" g— ^t(>=t) 
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then, in virtue of Eq. (|7.5p . the left hand side of Eq. (|8.3|) is equal to 

dx J f{xi . . . ,x„) Plt^(x,dxi) Pt^^t^(xi,dx2) ■■• Pl^^Tix„,dy) e"^'^'-^^ 
with the integral over xi, - ■ ■ ,x„. With the use of relation (|7.4p . this may be rewritten as 

Q-'PT(y)^y J f(xi...,x„)Po^t'^{y*,dx*„) •■■ Pq^t'^{x2,dxl) Pt.^T{x*i,dx*) 
and, after the change of variables x*^i ^ x'^-i, as 

This is equal to the left hand side of the identity (|8.3p since e~'^'^^^^dy = e"*'"'*' ^dy*. 

□ 

References 



[1 

[2: 
[3; 
K 

[s; 
[6; 
[7; 

[8 

[9; 
[10: 

[11 

[12 
[13 
[14 

[15 
[16 
[17" 
[18 



E. Balkovsky, G. Falkovich, A. Fouxon, "Clustering of inertial particles in turbulent flows", 
chao-dyn/9912027 and "Intermittent distribution of inertial particles in turbulent flows", Phys. 
Rev. Lett. 86 (2001), 2790-2793 

Bandi, M. M., Cressman Jr., J. R., Goldburg, W. I.: Test of the Fluctuation Relation in lagrangian 
turbulence on a free surface. ^arXiv: nlin/0607037 

Bee, J.: Multtfractal concentrations of inertial particles in smooth random flows. J. Fluid Mech. 528 
(2005), 255-277 

Bochkov G. N., Kuzovlev, Yu. E.: On general theory of thermal fluctuations in nonlinear systems. 
Sov.Phys. JETP 45 (1977), 125-130 Zh. Eksp. Teor. Fiz. 72 (1977), 238- 

Bochkov G. N., Kuzovlev, Yu. E.; Fluctuation-dissipation relations for nonequilibrium processes in 
open systems. Sov.Phys. JETP 49 (1979), 543- Zh. Eksp. Teor. Fiz. 76 (1979), 1071- 

Bochkov G. N., Kuzovlev, Yu. E.: Non-hnear fluctuation- dissipation relations and stochastic models 
in nonequilibrium thermodynamics. I and II. Physica bf A 106 (1981), 443-479 and 480-520 

Bonetto, F., Gallavotti, G., Garrido, P. L.: Chaotic principle: An experimental test. Physica D 105 
(1997), 226-252 

Bonetto, F., Gallavotti, G., Gentile, G: A fluctuation theorem in a random environment. mp_arc/06- 
139 

Bonetto, F., Gallavotti, G., Giuliani, A., Zamponi, F.: Chaotic Hypothesis, Fluctuation Theorem 
and singularities. mp_arc/05-257 

Chernyak, V., Chertkov, M., Jarzynski, C.: Path-integral analysis of fluctuation theorems for general 
Langevm processes. J. Stat. Mech. (2006), P08001 

Chetrite, R., Delannoy, J.-Y., Gaw§dzki, K.: Kraichnan flow in a square: an example of integrable 
chaos, J. Stat. Phys. 126 (2007), 1165-1200 

Chetrite, R., Falkovich, G., Gaw§dzki, K.: in preparation 

Chetrite, R., Horvai, P., Gaw§dzki, K.: in preparation 

Ciliberto, S. : Experimental analysis of aging. In: Slow Relaxations and Nonequilibrium Dynamics 
in Condensed Matter, eds. Barrat, J.-L. et al, Les Houches Summer School vol. 77, pp. 555-604, 
2004 

Ciliberto, S., Laroche, C: An experimental test of the Callavotti-Cohen fluctuation theorem. J. de 
Phys. IV 8 (1998), 215 

Cohen, E.G.D., Gallavotti, G.: Note on two theorems in nonequilibrium statistical mechanics. J. 
Stat. Phys. 96 (1999), 1343-1349 

Collin, D., Ritort, F., Jarzynski, C, Smith, S. B., Tinoco, I, Bustamante, C.: Verification of the 
Crooks fluctuation theorem and recovery of RNA folding free energies. Nature, 437 (2005), 231-234 

Crooks, G. E.: The entropy production fluctuation theorem and the nonequilibrium work relation 
for free energy differences. Phys. Rev. E 60 (1999), 2721-2726 



35 



[19] Crooks, G. E.: Path ensembles averages in systems driven far from equilibrium. Phys. Rev. E 61 
(2000), 2361-2366 

[20] Cugliandolo, L. F., Kurchan, J., Peliti, L.: Energy flow, partial equilibration and effective temper- 
ature in systems with slow dynamics. Phys. Rev. E 55 (1997), 3898-3914 

[21] Eckmann, J. -P., Pillet, C.-A., Rey-Bellet, L.: Non-equilibrium statistical mechanics of anharmonic 
chains coupled to two heat baths at different temperatures. Comm. Math. Phys. 201 (1999), 657-697 

[22] Eckmann, J. -P., Pillet, C.-A., Rey-Bellet, L.: Entropy production in nonlinear, thermally driven 
hamiltonian systems. J. Stat. Phys. 95 (1999), 305-331 

[23] Evans, D. J., Cohen E. G. D., Morriss, G. P.: Probability of second law violations in shearing steady 
states. Phys. Rev. Lett. 71 (1993), 2401-2404 and 3616 

[24] J. Evans, D. J., Morriss, G. P.: Statistical Mechanics of NonEquilibrium Liquids. Academic Press, 
London 1990 

[25] Evans, D. J., Searles, D. J.: EquUbrium microstates which generate the second law violating steady 
states. Phys. Rev. E 50 (1994), 1645 

[26] Evans, D. J., Searles, D. J.: The fluctuation theorem. Adv. in Phys., 51 (2002), 1529-1585 

[27] Eyink, G. L., Lebowitz, J. L., Spohn, H: Microscopic origin of hydrodynamic behavior: entropy 
production and the steady state. In: Chaos, Soviet-American Perspectives in Nonlinear Science, ed. 
D.K. Campbell, pp. 367-397, American Institute of Physics, 1990. 

[28] Falkovich, C; private communication 

[29] Falkovich, C, Gaw§dzki, K., Vergassola, M.: Particles and fields in fluid turbulence, Rev. Mod. 
Phys. 73 (2001), 913-975 

[30] Fouxon, I., Horvai, P.: Fluctuation relation and pairing rule for Lyapunov exponents of inertial 
particles in turbulence. larXiv:0705.6d73l 

[31] Gallavotti, G.: Fluctuation patterns and conditional reversibility in nonequilibnum systems. Ann. 
Inst. H. Poincare 70 (1999), 429 

[32] Gallavotti, G.; Extension of Onsager's reciprocity to large fields and the chaotic hypothesis. Phys. 
Rev. Lett. 77 (1996), 4334 - 4337 

[33] Gallavotti, G.: Fluctuation relation, fluctuation theorem, thermostats and entropy creation in non 
equilibrium statistical physics. arXiv:cond-mat/0612061 

[34] Gallavotti, G., Bonetto, F., Gentile, G.: Aspects of the Ergodic, Qualitative and Statistical Theory 
of Motion. Springer, Berlin 2004 

[35] Gallavotti, G., Cohen, E. D. G.: Dynamical ensembles m non-equilibrium statistical mechanics. 
Phys. Rev. Lett. 74 (1995), 2694-2697 

[36] Gallavotti, G., Cohen, E. D. G.: Dynamical ensembles m stationary states. J. Stat. Phys. 80 (1995), 
931-970 

[37] Garnier, N., Ciliberto, S.: Nonequilibnum fluctuations in a resistor. Phys. Rev. E 71 (2005), 
060101(R)/l-4 

[38] Giuliani, A., Zamponi, F., Gallavotti, G.: Fluctuation relation beyond linear response theory. 
J.Stat.Phys. 119 (2005), 909- 

[39] Gaspard, P.: Time-reversed dynamical entropy and irreversibility in Markovian random processes. 
J. Stat. Phys. 117 (2004), 599-615 

[40] Gaw§dzki, K.: Soluble models of turbulent transport. Warwick lecture notes 

[41] Halperin, B. I.; Green's functions for a particle in a one- dimensional random potential. Phys. Rev. 
139 (1965), A104-A117 

[42] Hashminski, R. Z.; Stochastic Stability of Differential Equations. Alphen, Sijthoff and Noordhoff 
1980 

[43] Hatano, T., Sasa, S.: Steady-state thermodynamics of Langevin systems. Phys. Rev. Lett. 86 (2001), 
3463-3466 

[44] Hayashi, K., Sasa, S.: Linear response theory in stochastic many-body systems revisited. Physica A 
370 (2006), 407-429 

[45] Hendrix, D. A., Jarzynski, C: A "fast growth" method of computing free energy differences. J. 
Chem. Phys. 114 (2001), 5974-5981 



36 



Hohenberg, B. C, Halperin, B. I.: Theory of dynamic critical phenomena. Rev. Mod. Phys. 49 
(1977), 435 - 479 

Imparato, A., Peliti, L., Pesce, G., Rusciano, G., Sasso, A.; Work and heat probability distribution 
of an optically driven Brownian particle; Theory and experiments. larXiv:0707.0439l 

Jarzynski, C: A noneqmUbrium equality for free energy differences. Phys. Rev. Lett. 78 (1997), 
2690-2693 

Jarzynski, C: Equilibrium free energy differences from nonequilibrium measurements: a master 
equation approach. Phys. Rev. E 56 (1997), 5018 

Jarzynski, C: Equilibnum Free Energies from Nonequilibrium Processes. Acta Physica Polonica B 
29 (1998), 1609 

Jarzynski, C.; Hamiltonian derivation of a detailed fluctuation theorem. J. Stat. Phys. 98 (2000), 77 



Jarzynski, C.: Comparison of far- from- equilibrium work relations. arXiv:cond-mat/0612305| 

Joubaud, S., Garnier, N., Ciliberto, S.; Fluctuation theorems for harmonic oscillators. 
,arXiv:cond-mat /0703798 

Joubaud, S., Garnier, N., Douarche, F., Petrosyan, A., Cihberto, S.: Experimental study of work 
fluctuations in a harmonic oscillator. |arXiv:cond-mat/0703695| 

Kunita, H.; Stochastic Flows and Stochastic Differential Equations. Cambridge University Press, 
London 1990 

Kurchan, J.; Fluctuation theorem for stochastic dynamics. J. Phys. A 31 (1998), 3719 



Kurchan, J.: Non- equilibrium work relations. ArXivxond-mat / 051 1073| 

Lebowitz, J. L., Spohn, H.: Stationary non- equilibrium states of infinite harmonic systems. Com- 
mun. Math. Phys. 54 (1977), 97-120 

Lebowitz, J., Spohn, H.: A Gallavotti- Cohen type symmetry m the large deviation functional for 
stochastic dynamics. J. Stat. Phys. 95 (1999), 333 

Le Jan, Y., Raimond, O.: Integration of Brownian vector fields. Ann. Probab. 30 (2002), 826-873, 
and Flows, coalescence and noise. Ann. Probab. 32 (2004), 1247-1315 

Lifshitz, LM., Gredeskul, S., Pastur, L.: Introduction to the Theory of Disordered Systems. Wiley 
N.Y. 1988 

Kraichnan, R. H.: Small-scale structure of a scalar field convected by turbulence. Phys. Fluids 11 
(1968), 945-963 

Maes, C.: The Fluctuation Theorem as a Cibbs Property. J. Stat. Phys. 95 (1999), 367-392 

Maes, C.: On the origin and the use of fluctuation relations for the entropy. Seminaire Poincare bf 
2 (2003), 29-62 

Maes, C., Natocny, K: Time reversal and entropy. J. Stat. Phys. 110 (2003), 269-310 

Oksendal, B.: Stochastic Differential Equations, 6th ed. Universitext, Springer, Berlin 2003 

Oono, Y., Paniconi, M.: Steady state thermodynamics. Prog. Theor. Phys. Suppl. 130 (1998), 29-44 

Parisi, G., Sourlas, N.: Supersymmetric field theories and stochastic differential equations. Nucl. 
Phys. B 206 (1982), 321-331 

Puglisi, A., Rondoni, L., Vulpiani, A.: Relevance of initial and final conditions for the Fluctuation 
Relation in Markov processes. J. Stat. Mech. (2006) P08010/1-22 

Risken, H.: The Fokker Planck Equation. Springer, Berlin, 1989 

Ritort, F.: Work fluctuations and transient violations of the Second Law: perspectives in theory and 
experiments. Seminaire Poincare 2 (2003), 63-87 

Ritort, F.: Nonequilibrium fluctuations in small systems: From physics to biology. arXiv: 0705.0455, 
to appear in Advances in Chemical Physics, Vol. 137, Wiley & Sons 

Ruelle, D.: Smooth Dynamics and New Theoretical Ideas in Nonequilibrium Statistical Mechanics, 
J. Stat. Phys. 95 (1999), 393-468 

Ruelle, D.: Thermodynamic Formalism: The Mathematical Structure of Equilibrium Statistical 
Mechanics, 2"^^ Edition, Cambridge University Press 2004 

Searles, D. J., Evans, D. J.: Fluctuation theorem for stochastic systems. Phys. Rev. E 60 (1999), 
159-164 



37 



[76] Searles, D. J., Rondoni, L., Evans, D. J.: The steady state fluctuation relation for the dissipation 
function, http://rsc.anu. edu.au^evans/index.php 

[77] Speck, T., Seifert, U.: Integral fluctuation theorem for the housekeeping heat. J. Phys. A: Math. 
Gen. 38 (2005), L581-L588 

[78] Stroock, D., Varadhan, S. R. S.: Multidimensional Diffusion Processes. Springer, Berlin 1979 

[79] Tailleur, J., Tanase-Nicola, S., Kurchan, J.: Kramers equation and supersymmetry. J. Stat. Phys. 
122 (2006), 557-595 

[80] Turitsyn, K., Chertkov, M., Chernyak, V. Y., Puliafito, A.: Statistics of entropy production in 
linearized stochastic system. Phys. Rev. Lett. 98 (2007), 180603/1-4 

[81] Young, L.-S.: What are SRB measures, and which dynamical systems have them. J. Stat. Phys. 108 

(2002) , 733-754 

[82] van Zon, R., Cohen, E. G. D. : Extension of the Fluctuation Theorem. Phys Rev. Lett. 91 (2003), 
110601/1-4 

[83] Wilkinson, M., Mehlig, B.: The path- coalescence transition and its applications. Phys. Rev. E 68 

(2003) , 040101/1-4 

[84] Witten, E.: Supersymmetry and Morse theory. J. Diff. Geom. 17 (1982), 661-692 

[85] Williams, S.R., Searles, D. J., Evans, D. J.: Numerical study of the steady state fluctuation relations 
far from equilibrium. Journal of Chemical Physics 124 (2006), 194102/1-9 

[86] Zwanzig, R.: Nonequilibrium Statistical Mechanics. Oxford University Press 2002 



38 



